Jul 23 03:11:18 devstack cinder-volume[77320]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 03:11:18 devstack cinder-volume[77320]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:11:18 devstack cinder-volume[77320]: we strongly recommend against using it for new projects. Jul 23 03:11:18 devstack cinder-volume[77320]: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:11:18 devstack cinder-volume[77320]: framework. For more detail see Jul 23 03:11:18 devstack cinder-volume[77320]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:11:18 devstack cinder-volume[77320]: import eventlet # noqa Jul 23 03:11:21 devstack cinder-volume[77320]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:11:21 devstack cinder-volume[77320]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:11:21 devstack cinder-volume[77320]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:11:22 devstack cinder-volume[77320]: INFO dbcounter [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Registered counter for database cinder Jul 23 03:11:22 devstack cinder-volume[77320]: DEBUG oslo_db.sqlalchemy.engines [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:22 devstack cinder-volume[77320]: DEBUG dbcounter [-] [77320] Writer thread running {{(pid=77320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:11:22 devstack cinder-volume[77320]: INFO cinder.rpc [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 03:11:22 devstack cinder-volume[77320]: INFO cinder.rpc [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 03:11:22 devstack cinder-volume[77320]: DEBUG oslo_db.sqlalchemy.engines [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:22 devstack cinder-volume[77320]: INFO cinder.volume.manager [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Determined volume DB was empty at startup. Jul 23 03:11:22 devstack cinder-volume[77320]: DEBUG cinder.volume.manager [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77320) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 03:11:22 devstack cinder-volume[77320]: INFO cinder.volume.manager [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 23 03:11:22 devstack cinder-volume[77320]: WARNING stevedore.named [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:11:22 devstack cinder-volume[77320]: WARNING castellan.key_manager [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:11:22 devstack cinder-volume[77320]: WARNING cinder.keymgr.conf_key_mgr [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:11:22 devstack cinder-volume[77320]: DEBUG cinder.volume.drivers.lvm [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77320) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 23 03:11:22 devstack cinder-volume[77320]: DEBUG oslo_concurrency.processutils [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_concurrency.processutils [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] CMD "cinder-rtstool verify" returned: 0 in 0.449s {{(pid=77320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_db.sqlalchemy.engines [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:23 devstack cinder-volume[77320]: INFO cinder.rpc [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 23 03:11:23 devstack cinder-volume[77320]: INFO cinder.rpc [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 23 03:11:23 devstack cinder-volume[77320]: WARNING stevedore.named [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:11:23 devstack cinder-volume[77320]: WARNING castellan.key_manager [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:11:23 devstack cinder-volume[77320]: INFO cinder.volume.manager [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_db.sqlalchemy.engines [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:23 devstack cinder-volume[77320]: INFO oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Starting 1 workers Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Started child 77515 {{(pid=77320) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Full set of CONF: {{(pid=77320) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] ******************************************************************************** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Configuration options gathered from: {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 03:11:23 devstack cinder-volume[77515]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] ================================================================================ {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] allow_availability_zone_fallback = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] allow_compression_on_image_upload = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] allowed_direct_url_schemes = [] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] api_rate_limit = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] auth_strategy = keystone {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] az_cache_duration = 3600 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_availability_zone = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_host = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_name = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_stats_polling_interval = 60 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backup_api_class = cinder.backup.api.API {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backup_name_template = backup-%s {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backup_use_same_host = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backup_use_temp_snapshot = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] chap_password = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] chap_username = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cinder_internal_tenant_project_id = 2758fba316ae431ba4bb86f3900d65c5 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cinder_internal_tenant_user_id = 7725001c22894988821c54e1c3b33777 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cloned_volume_same_az = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cluster = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] compression_format = gzip {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] compute_api_class = cinder.compute.nova.API {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] config_dir = [] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] config_source = [] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] control_exchange = openstack {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] debug = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] default_availability_zone = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] default_group_type = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] default_volume_type = lvmdriver-1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] disk_geometry = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] driver_client_cert = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] driver_client_cert_key = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] driver_data_namespace = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] driver_ssl_cert_path = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] driver_ssl_cert_verify = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] driver_use_ssl = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] enable_force_upload = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] enable_new_services = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] enable_unsupported_driver = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] enabled_backends = ['lvmdriver-1'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] enforce_multipath_for_image_xfer = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] filter_function = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance_api_insecure = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance_api_servers = ['http://192.168.122.42/image'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance_api_ssl_compression = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance_ca_certificates_file = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance_catalog_info = image:glance:publicURL {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance_certfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance_keyfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance_num_retries = 3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance_request_timeout = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] goodness_function = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] graceful_shutdown_timeout = 5 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] group_api_class = cinder.group.api.API {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] host = devstack {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] image_compress_on_upload = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] image_conversion_address_space_limit = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] image_conversion_cpu_limit = 60 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] image_conversion_disable = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] image_upload_use_cinder_backend = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] image_upload_use_internal_tenant = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] image_volume_cache_enabled = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] image_volume_cache_max_count = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] image_volume_cache_max_size_gb = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] init_host_max_objects_retrieval = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] instance_format = [instance: %(uuid)s] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] iscsi_target_flags = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] iscsi_write_cache = on {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] iser_helper = tgtadm {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] iser_ip_address = 192.168.122.42 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] iser_port = 3260 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] log_color = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] log_config_append = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] log_dir = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] log_file = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] log_options = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] log_rotate_interval = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] log_rotate_interval_type = days {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] log_rotation_type = none {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] max_age = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] max_logfile_count = 30 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] max_logfile_size_mb = 200 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] max_over_subscription_ratio = 20.0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] message_reap_interval = 86400 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] message_ttl = 2592000 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] migration_create_volume_timeout_secs = 300 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] monkey_patch = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] monkey_patch_modules = [] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] my_ip = 192.168.122.42 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] no_snapshot_gb_quota = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] num_iser_scan_tries = 3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] num_shell_tries = 3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] num_volume_device_scan_tries = 3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] nvmeof_conn_info_version = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] nvmet_ns_id = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] nvmet_port_id = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] osapi_max_limit = 1000 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] osapi_volume_ext_list = [] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] osapi_volume_listen = 0.0.0.0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] osapi_volume_listen_port = 8776 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] osapi_volume_use_ssl = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] osapi_volume_workers = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] per_volume_size_limit = -1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] periodic_fuzzy_delay = 60 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] periodic_interval = 60 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] project_id_regex = [0-9a-f\-]+ {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] public_endpoint = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] publish_errors = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] quota_backup_gigabytes = 1000 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] quota_backups = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] quota_gigabytes = 1000 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] quota_groups = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] quota_snapshots = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] quota_volumes = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] rate_limit_burst = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] rate_limit_except_level = CRITICAL {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] rate_limit_interval = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] reinit_driver_count = 3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] replication_device = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] report_discard_supported = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] report_interval = 120 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] reservation_clean_interval = 86400 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] reservation_expire = 86400 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] reserved_image_namespaces = [] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] reserved_percentage = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] rpc_response_timeout = 120 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] run_external_periodic_tasks = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] scst_target_driver = iscsi {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] scst_target_iqn_name = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] service_down_time = 720 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] shell_completion = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] snapshot_name_template = snapshot-%s {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] snapshot_same_host = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] split_loggers = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] state_path = /opt/stack/data/cinder {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] storage_availability_zone = nova {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] storage_protocol = iSCSI {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77515]: INFO cinder.volume.manager [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] syslog_log_facility = LOG_USER {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] target_helper = lioadm {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] target_ip_address = 192.168.122.42 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] target_port = 3260 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] target_protocol = iscsi {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] target_secondary_ip_addresses = [] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] trace_flags = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] transfer_api_class = cinder.transfer.api.API {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] transport_url = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] until_refresh = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] use_chap_auth = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] use_default_quota_class = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] use_journal = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] use_json = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] use_multipath_for_image_xfer = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] use_stderr = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] use_syslog = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] verify_glance_signatures = enabled {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_api_class = cinder.volume.api.API {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_backend_name = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_clear = zero {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_clear_ionice = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_clear_size = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_copy_bps_limit = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_dd_blocksize = 1M {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_name_template = volume-%s {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_service_inithost_offload = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volume_usage_audit_period = month {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] zoning_mode = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_concurrency.disable_process_locking = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.auth_section = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.auth_type = password {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.auth_version = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.cache = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.certfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.delay_auth_decision = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.http_connect_timeout = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.include_service_catalog = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.insecure = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.interface = public {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.keyfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_password = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcache_username = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.region_name = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.service_token_roles_required = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.service_type = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.token_cache_time = 300 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.42/identity {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.backend = dogpile.cache.null {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.backend_argument = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.backend_expiration_time = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.config_prefix = cache.oslo {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.debug_cache_backend = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.enable_retry_client = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.enable_socket_keepalive = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.enabled = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.expiration_time = 600 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.hashclient_retry_attempts = 2 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.memcache_dead_retry = 300 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.memcache_pool_maxsize = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.memcache_sasl_enabled = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.password = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.proxies = [] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.redis_db = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.redis_sentinel_service_name = mymaster {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.redis_server = localhost:6379 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.retry_attempts = 2 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.retry_delay = 0.0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.socket_keepalive_count = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.socket_keepalive_idle = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.socket_keepalive_interval = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.socket_timeout = 1.0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.tls_allowed_ciphers = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.tls_cafile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.tls_certfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.tls_enabled = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.tls_keyfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cache.username = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] coordination.backend_url = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.asyncio_connection = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.asyncio_slave_connection = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.backend = sqlalchemy {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.connection = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.connection_debug = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.connection_parameters = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.connection_recycle_time = 3600 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.connection_trace = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.db_inc_retry_interval = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.db_max_retries = 20 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.db_max_retry_interval = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.db_retry_interval = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.max_overflow = 50 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.max_pool_size = 5 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.max_retries = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.mysql_wsrep_sync_wait = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.pool_timeout = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.retry_interval = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.slave_connection = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.sqlite_synchronous = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.synchronous_reader = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] database.use_db_reconnect = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler.connection_string = messaging:// {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler.enabled = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler.es_doc_type = notification {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler.es_scroll_size = 10000 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler.es_scroll_time = 2m {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler.filter_error_trace = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler.hmac_keys = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler.sentinel_service_name = mymaster {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler.socket_timeout = 0.1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler.trace_requests = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler.trace_sqlalchemy = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler_jaeger.process_tags = {} {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler_jaeger.service_name_prefix = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] profiler_otlp.service_name_prefix = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_policy.enforce_new_defaults = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_policy.policy_default_rule = default {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_policy.policy_file = policy.yaml {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_policy.remote_timeout = 60.0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] privsep_osbrick.group = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] privsep_osbrick.helper_command = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] privsep_osbrick.user = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:23 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cinder_sys_admin.group = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cinder_sys_admin.helper_command = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] cinder_sys_admin.user = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] service_user.auth_section = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] service_user.auth_type = password {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] service_user.cafile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] service_user.certfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] service_user.collect_timing = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] service_user.insecure = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] service_user.keyfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] service_user.send_service_user_token = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] service_user.split_loggers = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] service_user.timeout = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance.auth_section = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance.auth_type = password {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance.certfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance.collect_timing = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance.insecure = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance.keyfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance.region_name = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance.split_loggers = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] glance.timeout = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.backend_availability_zone = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.chap_password = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.chap_username = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.disk_geometry = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.driver_client_cert = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.driver_client_cert_key = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.driver_data_namespace = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.driver_use_ssl = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.enable_unsupported_driver = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.extra_capabilities = {} {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.filter_function = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.goodness_function = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.iscsi_target_flags = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.iscsi_write_cache = on {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.iser_helper = tgtadm {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.iser_ip_address = 192.168.122.42 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.iser_port = 3260 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.lvm_mirrors = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.lvm_share_target = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.lvm_type = auto {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.num_shell_tries = 3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.nvmet_port_id = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.replication_device = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.report_discard_supported = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.reserved_percentage = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.scst_target_driver = iscsi {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.scst_target_iqn_name = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.storage_protocol = iSCSI {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.target_helper = tgtadm {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.target_ip_address = 192.168.122.42 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.target_port = 3260 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.target_protocol = iscsi {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.trace_flags = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.unique_fqdn_network = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.use_chap_auth = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.volume_backend_name = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.volume_clear = zero {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.volume_clear_ionice = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.volume_clear_size = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.volume_group = cinder-volumes {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_reports.file_event_handler = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:23 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_reports.log_dir = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.backend_availability_zone = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.backend_host = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.chap_password = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.chap_username = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.chiscsi_conf = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.disk_geometry = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.driver_client_cert = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.driver_data_namespace = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.driver_use_ssl = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.extra_capabilities = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.filter_function = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.goodness_function = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.iser_helper = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.iser_ip_address = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.iser_port = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.iser_target_prefix = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.lvm_conf_file = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.lvm_mirrors = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.lvm_share_target = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.lvm_type = auto {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.num_shell_tries = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.nvmet_port_id = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.replication_device = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.report_discard_supported = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.reserved_percentage = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.scst_target_driver = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack sudo[77519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.storage_protocol = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.target_helper = lioadm {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.target_ip_address = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.target_port = 3260 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.target_protocol = iscsi {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.trace_flags = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.use_chap_auth = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.volume_clear = zero {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack sudo[77519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.volume_clear_size = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] lvmdriver-1.volumes_dir = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.ssl = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.ssl_version = {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_notifications.driver = [] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_notifications.retry = -1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] oslo_messaging_notifications.transport_url = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] key_manager.fixed_key = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.barbican_api_version = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.barbican_endpoint = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.barbican_endpoint_type = public {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.barbican_region_name = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.cafile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.certfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.collect_timing = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.insecure = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.keyfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.number_of_retries = 60 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.retry_delay = 1 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.send_service_user_token = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.split_loggers = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.timeout = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.verify_ssl = True {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican.verify_ssl_path = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican_service_user.auth_section = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican_service_user.auth_type = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican_service_user.cafile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican_service_user.certfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican_service_user.collect_timing = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican_service_user.insecure = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican_service_user.keyfile = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican_service_user.split_loggers = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] barbican_service_user.timeout = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.approle_role_id = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.approle_secret_id = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.auth_method = approle {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.auth_path = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.kv_mountpoint = secret {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.kv_path = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.kv_version = 2 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.namespace = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.root_token_id = **** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.ssl_ca_crt_file = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.timeout = 60.0 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.token_file = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.token_role = None {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.use_ssl = False {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:11:23 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] ******************************************************************************** {{(pid=77320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 03:11:24 devstack sudo[77519]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:24 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.343s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:24 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:24 devstack sudo[77523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:24 devstack sudo[77523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:24 devstack sudo[77523]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:24 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.288s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:24 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:11:24 devstack cinder-volume[77515]: INFO cinder.brick.local_dev.lvm [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 23 03:11:24 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:24 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:24 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:24 devstack sudo[77527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:24 devstack sudo[77527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:24 devstack sudo[77527]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:24 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:24 devstack cinder-volume[77515]: DEBUG cinder.brick.local_dev.lvm [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77515) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 23 03:11:24 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:24 devstack sudo[77550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:24 devstack sudo[77550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:25 devstack sudo[77550]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:25 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:25 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:25 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:25 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:25 devstack sudo[77796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:25 devstack sudo[77796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:25 devstack sudo[77796]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:25 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:25 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:25 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:25 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:25 devstack sudo[77894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 23 03:11:25 devstack sudo[77894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:26 devstack sudo[77894]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:26 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.259s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:26 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack sudo[77982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:26 devstack sudo[77982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:26 devstack sudo[77982]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:26 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:26 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack sudo[78057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:26 devstack sudo[78057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:26 devstack sudo[78057]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:26 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:26 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack sudo[78140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:26 devstack sudo[78140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:26 devstack sudo[78140]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:26 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:26 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:26 devstack sudo[78145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:26 devstack sudo[78145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:27 devstack sudo[78145]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:27 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:27 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:27 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:27 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:27 devstack sudo[78227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:27 devstack sudo[78227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:27 devstack sudo[78227]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:27 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:27 devstack cinder-volume[77515]: INFO cinder.volume.drivers.lvm [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 23 03:11:27 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:27 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:27 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:27 devstack sudo[78231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:27 devstack sudo[78231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:27 devstack sudo[78231]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:27 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:27 devstack cinder-volume[77515]: DEBUG cinder.volume.drivers.lvm [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Updating volume stats {{(pid=77515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:11:27 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:27 devstack sudo[78320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:27 devstack sudo[78320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:28 devstack sudo[78320]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:28 devstack sudo[78323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:28 devstack sudo[78323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:28 devstack sudo[78323]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:28 devstack sudo[78326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:28 devstack sudo[78326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:28 devstack sudo[78326]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:28 devstack sudo[78329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:28 devstack sudo[78329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:28 devstack sudo[78329]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:28 devstack cinder-volume[77515]: INFO cinder.volume.driver [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Driver hasn't implemented _init_vendor_properties() Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG cinder.volume.driver [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77515) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG oslo_db.sqlalchemy.engines [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77515) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG dbcounter [-] [77515] Writer thread running {{(pid=77515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG cinder.db.api [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Building query based on filter {{(pid=77515) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 03:11:28 devstack cinder-volume[77515]: DEBUG cinder.image.image_utils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77515) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 03:11:29 devstack cinder-volume[77515]: INFO cinder.keymgr.migration [None req-d6834aa8-d820-4311-8208-88af68434f1d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 03:11:29 devstack cinder-volume[77515]: DEBUG cinder.volume.drivers.lvm [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Updating volume stats {{(pid=77515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:11:29 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:29 devstack sudo[78339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:29 devstack sudo[78339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:29 devstack sudo[78339]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:29 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:29 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:29 devstack sudo[78342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:29 devstack sudo[78342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:29 devstack sudo[78342]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:29 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:29 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:29 devstack sudo[78345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:29 devstack sudo[78345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:29 devstack sudo[78345]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:29 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:29 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:29 devstack sudo[78348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:29 devstack sudo[78348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:30 devstack sudo[78348]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:30 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77515]: DEBUG cinder.manager [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Notifying Schedulers of capabilities ... {{(pid=77515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:11:30 devstack cinder-volume[77515]: INFO cinder.volume.manager [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Driver initialization completed successfully. Jul 23 03:11:30 devstack cinder-volume[77515]: INFO cinder.manager [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Initiating service 2 cleanup Jul 23 03:11:30 devstack cinder-volume[77515]: INFO cinder.manager [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Service 2 cleanup completed. Jul 23 03:11:30 devstack cinder-volume[77515]: DEBUG cinder.service [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Creating RPC server for service cinder-volume {{(pid=77515) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 03:11:30 devstack cinder-volume[77515]: DEBUG cinder.service [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77515) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 03:11:30 devstack cinder-volume[77515]: INFO cinder.volume.manager [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 23 03:11:30 devstack cinder-volume[77515]: DEBUG cinder.volume.drivers.lvm [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Updating volume stats {{(pid=77515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:11:30 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack sudo[78353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:11:30 devstack sudo[78353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:30 devstack sudo[78353]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:30 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack sudo[78357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:30 devstack sudo[78357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:30 devstack sudo[78357]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:30 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:30 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:30 devstack sudo[78360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:11:30 devstack sudo[78360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:31 devstack sudo[78360]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:31 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:31 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:11:31 devstack sudo[78365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:11:31 devstack sudo[78365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:11:31 devstack sudo[78365]: pam_unix(sudo:session): session closed for user root Jul 23 03:11:31 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:11:31 devstack cinder-volume[77515]: INFO cinder.volume.manager [None req-36795e36-f441-4415-b47e-1201bf759d41 None None] Driver post RPC initialization completed successfully. Jul 23 03:11:33 devstack cinder-volume[77320]: DEBUG dbcounter [-] [77320] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:11:41 devstack cinder-volume[77515]: DEBUG dbcounter [-] [77515] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:11:41 devstack cinder-volume[77515]: DEBUG dbcounter [-] [77515] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:11:54 devstack cinder-volume[77515]: DEBUG oslo_service.periodic_task [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running periodic task VolumeManager._thread_info {{(pid=77515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:11:54 devstack cinder-volume[77515]: DEBUG cinder.volume.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] thread count: 6 {{(pid=77515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:11:54 devstack cinder-volume[77515]: DEBUG cinder.volume.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] thread info: [<_MainThread(MainThread, started 134382891974784)>, , , , , ] {{(pid=77515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:12:54 devstack cinder-volume[77515]: DEBUG oslo_service.periodic_task [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:12:54 devstack cinder-volume[77515]: DEBUG cinder.volume.drivers.lvm [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Updating volume stats {{(pid=77515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:12:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:12:54 devstack sudo[81005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:12:54 devstack sudo[81005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:12:54 devstack sudo[81005]: pam_unix(sudo:session): session closed for user root Jul 23 03:12:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:12:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:12:54 devstack sudo[81008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:12:54 devstack sudo[81008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:12:54 devstack sudo[81008]: pam_unix(sudo:session): session closed for user root Jul 23 03:12:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:12:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:12:54 devstack sudo[81011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:12:54 devstack sudo[81011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:12:55 devstack sudo[81011]: pam_unix(sudo:session): session closed for user root Jul 23 03:12:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:12:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:12:55 devstack sudo[81014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:12:55 devstack sudo[81014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:12:55 devstack sudo[81014]: pam_unix(sudo:session): session closed for user root Jul 23 03:12:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:12:55 devstack cinder-volume[77515]: DEBUG cinder.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Notifying Schedulers of capabilities ... {{(pid=77515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:12:55 devstack cinder-volume[77515]: DEBUG oslo_service.periodic_task [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running periodic task VolumeManager._thread_info {{(pid=77515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:12:55 devstack cinder-volume[77515]: DEBUG cinder.volume.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] thread count: 6 {{(pid=77515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:12:55 devstack cinder-volume[77515]: DEBUG cinder.volume.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] thread info: [<_MainThread(MainThread, started 134382891974784)>, , , , , ] {{(pid=77515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:13:41 devstack cinder-volume[77515]: DEBUG dbcounter [-] [77515] Writing DB stats cinder:SELECT=1 {{(pid=77515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:13:41 devstack cinder-volume[77515]: DEBUG dbcounter [-] [77515] Writing DB stats cinder:UPDATE=1 {{(pid=77515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:13:54 devstack cinder-volume[77515]: DEBUG oslo_service.periodic_task [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:13:54 devstack cinder-volume[77515]: DEBUG cinder.volume.drivers.lvm [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Updating volume stats {{(pid=77515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:13:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:54 devstack sudo[84397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:13:54 devstack sudo[84397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:54 devstack sudo[84397]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:54 devstack sudo[84589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:13:54 devstack sudo[84589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:54 devstack sudo[84589]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:54 devstack sudo[84625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:13:54 devstack sudo[84625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:55 devstack sudo[84625]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:13:55 devstack sudo[84633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:13:55 devstack sudo[84633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:13:55 devstack sudo[84633]: pam_unix(sudo:session): session closed for user root Jul 23 03:13:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:13:55 devstack cinder-volume[77515]: DEBUG cinder.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Notifying Schedulers of capabilities ... {{(pid=77515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:13:55 devstack cinder-volume[77515]: DEBUG oslo_service.periodic_task [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running periodic task VolumeManager._thread_info {{(pid=77515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:13:55 devstack cinder-volume[77515]: DEBUG cinder.volume.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] thread count: 6 {{(pid=77515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:13:55 devstack cinder-volume[77515]: DEBUG cinder.volume.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] thread info: [<_MainThread(MainThread, started 134382891974784)>, , , , , ] {{(pid=77515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:14:54 devstack cinder-volume[77515]: DEBUG oslo_service.periodic_task [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:14:54 devstack cinder-volume[77515]: DEBUG cinder.volume.drivers.lvm [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Updating volume stats {{(pid=77515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:14:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:54 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:14:54 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:54 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:54 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:14:54 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:54 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:54 devstack sudo[86284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:14:54 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:55 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:14:55 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:14:55 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:14:55 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Jul 23 03:14:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:14:55 devstack cinder-volume[77515]: DEBUG cinder.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Notifying Schedulers of capabilities ... {{(pid=77515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:15:41 devstack cinder-volume[77515]: DEBUG dbcounter [-] [77515] Writing DB stats cinder:SELECT=1 {{(pid=77515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:15:41 devstack cinder-volume[77515]: DEBUG dbcounter [-] [77515] Writing DB stats cinder:UPDATE=1 {{(pid=77515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:15:52 devstack cinder-volume[77320]: INFO oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Caught SIGTERM, stopping children Jul 23 03:15:52 devstack cinder-volume[77320]: DEBUG oslo_concurrency.lockutils [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Acquiring lock "singleton_lock" {{(pid=77320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:15:52 devstack cinder-volume[77320]: DEBUG oslo_concurrency.lockutils [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Acquired lock "singleton_lock" {{(pid=77320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:15:52 devstack cinder-volume[77320]: DEBUG oslo_concurrency.lockutils [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Releasing lock "singleton_lock" {{(pid=77320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:15:52 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Stop services. {{(pid=77320) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 23 03:15:52 devstack cinder-volume[77320]: DEBUG oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Killing children. {{(pid=77320) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 23 03:15:52 devstack cinder-volume[77320]: INFO oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Waiting on 1 children to exit Jul 23 03:15:54 devstack cinder-volume[77515]: DEBUG oslo_service.periodic_task [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:15:54 devstack cinder-volume[77515]: DEBUG cinder.volume.drivers.lvm [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Updating volume stats {{(pid=77515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 03:15:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:54 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 03:15:54 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:54 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:54 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:15:54 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:54 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:54 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:54 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 03:15:54 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:55 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:55 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 03:15:55 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:15:55 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Jul 23 03:15:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.processutils [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:55 devstack cinder-volume[77515]: DEBUG cinder.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Notifying Schedulers of capabilities ... {{(pid=77515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:15:55 devstack cinder-volume[77515]: DEBUG oslo_service.periodic_task [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] Running periodic task VolumeManager._thread_info {{(pid=77515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:15:55 devstack cinder-volume[77515]: DEBUG cinder.volume.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] thread count: 5 {{(pid=77515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:15:55 devstack cinder-volume[77515]: DEBUG cinder.volume.manager [None req-7a8e1a32-87c7-4cbf-a320-909f3f61ec9b None None] thread info: [<_MainThread(MainThread, started 134382891974784)>, , , , ] {{(pid=77515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:15:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.lockutils [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Acquiring lock "singleton_lock" {{(pid=77515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:15:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.lockutils [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Acquired lock "singleton_lock" {{(pid=77515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:15:55 devstack cinder-volume[77515]: DEBUG oslo_concurrency.lockutils [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Releasing lock "singleton_lock" {{(pid=77515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:15:55 devstack cinder-volume[77515]: WARNING amqp [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:15:55 devstack cinder-volume[77515]: WARNING amqp [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:15:55 devstack cinder-volume[77320]: INFO oslo_service.backend._eventlet.service [None req-c29a3040-78c1-47fa-b462-4b13df07ab4f None None] Child 77515 exited with status 0 Jul 23 03:15:55 devstack cinder-volume[87597]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 03:15:55 devstack cinder-volume[87597]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:15:55 devstack cinder-volume[87597]: we strongly recommend against using it for new projects. Jul 23 03:15:55 devstack cinder-volume[87597]: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:15:55 devstack cinder-volume[87597]: framework. For more detail see Jul 23 03:15:55 devstack cinder-volume[87597]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:15:55 devstack cinder-volume[87597]: import eventlet # noqa Jul 23 03:15:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:15:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:15:57 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:15:58 devstack cinder-volume[87597]: INFO dbcounter [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Registered counter for database cinder Jul 23 03:15:58 devstack cinder-volume[87597]: DEBUG oslo_db.sqlalchemy.engines [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:15:58 devstack cinder-volume[87597]: DEBUG dbcounter [-] [87597] Writer thread running {{(pid=87597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:15:58 devstack cinder-volume[87597]: INFO cinder.rpc [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 03:15:58 devstack cinder-volume[87597]: INFO cinder.rpc [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_db.sqlalchemy.engines [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:15:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Determined volume DB was empty at startup. Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG cinder.volume.manager [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87597) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 03:15:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 23 03:15:59 devstack cinder-volume[87597]: WARNING stevedore.named [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:15:59 devstack cinder-volume[87597]: WARNING castellan.key_manager [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:15:59 devstack cinder-volume[87597]: WARNING cinder.keymgr.conf_key_mgr [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:15:59 devstack cinder-volume[87597]: INFO cinder.volume.manager [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_db.sqlalchemy.engines [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:15:59 devstack cinder-volume[87597]: INFO oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Starting 1 workers Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Started child 87812 {{(pid=87597) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Full set of CONF: {{(pid=87597) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] ******************************************************************************** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Configuration options gathered from: {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] ================================================================================ {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] allow_availability_zone_fallback = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] allow_compression_on_image_upload = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] allowed_direct_url_schemes = [] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] api_rate_limit = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] auth_strategy = keystone {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_availability_zone = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_host = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_name = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_stats_polling_interval = 60 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backup_api_class = cinder.backup.api.API {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backup_name_template = backup-%s {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backup_use_same_host = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backup_use_temp_snapshot = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] chap_password = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] chap_username = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cinder_internal_tenant_project_id = 2758fba316ae431ba4bb86f3900d65c5 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cinder_internal_tenant_user_id = 7725001c22894988821c54e1c3b33777 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cluster = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] compression_format = gzip {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] compute_api_class = cinder.compute.nova.API {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87812]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] config_dir = [] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] config_source = [] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] control_exchange = openstack {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] debug = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] default_availability_zone = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] default_group_type = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] default_volume_type = QuobyteHD {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] disk_geometry = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] driver_client_cert = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] driver_client_cert_key = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] driver_data_namespace = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] driver_ssl_cert_path = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] driver_ssl_cert_verify = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] driver_use_ssl = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] enable_new_services = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] enable_unsupported_driver = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] enabled_backends = ['QuobyteHD'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] enforce_multipath_for_image_xfer = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] filter_function = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance_api_insecure = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance_api_servers = ['http://192.168.122.42/image'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance_api_ssl_compression = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance_ca_certificates_file = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance_catalog_info = image:glance:publicURL {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance_certfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance_keyfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance_num_retries = 3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance_request_timeout = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] goodness_function = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] graceful_shutdown_timeout = 5 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] group_api_class = cinder.group.api.API {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] host = devstack {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] image_compress_on_upload = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] image_conversion_address_space_limit = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] image_conversion_cpu_limit = 60 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] image_conversion_disable = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] image_upload_use_cinder_backend = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] image_upload_use_internal_tenant = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] image_volume_cache_enabled = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] image_volume_cache_max_count = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] image_volume_cache_max_size_gb = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] init_host_max_objects_retrieval = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] instance_format = [instance: %(uuid)s] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] iscsi_target_flags = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] iscsi_write_cache = on {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] iser_helper = tgtadm {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] iser_ip_address = 192.168.122.42 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] iser_port = 3260 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] log_color = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] log_config_append = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] log_dir = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] log_file = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] log_options = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] log_rotate_interval = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] log_rotate_interval_type = days {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] log_rotation_type = none {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] max_age = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] max_logfile_count = 30 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] max_logfile_size_mb = 200 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] max_over_subscription_ratio = 20.0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] message_reap_interval = 86400 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] message_ttl = 2592000 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] migration_create_volume_timeout_secs = 300 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] monkey_patch = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] monkey_patch_modules = [] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] my_ip = 192.168.122.42 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] no_snapshot_gb_quota = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] num_iser_scan_tries = 3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] num_shell_tries = 3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] num_volume_device_scan_tries = 3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] nvmeof_conn_info_version = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] nvmet_ns_id = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] nvmet_port_id = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] osapi_max_limit = 1000 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] osapi_volume_ext_list = [] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] osapi_volume_listen_port = 8776 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] osapi_volume_use_ssl = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] osapi_volume_workers = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] per_volume_size_limit = -1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] periodic_fuzzy_delay = 60 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] periodic_interval = 60 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] public_endpoint = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] publish_errors = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] quota_backup_gigabytes = 1000 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] quota_backups = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] quota_gigabytes = 1000 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] quota_groups = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] quota_snapshots = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] quota_volumes = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] rate_limit_burst = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] rate_limit_except_level = CRITICAL {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] rate_limit_interval = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] reinit_driver_count = 3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] replication_device = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] report_discard_supported = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] report_interval = 120 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] reservation_clean_interval = 86400 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] reservation_expire = 86400 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] reserved_image_namespaces = [] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] reserved_percentage = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] rpc_response_timeout = 120 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] run_external_periodic_tasks = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] scst_target_driver = iscsi {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] scst_target_iqn_name = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] service_down_time = 720 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] shell_completion = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] snapshot_name_template = snapshot-%s {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] split_loggers = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] state_path = /opt/stack/data/cinder {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] storage_availability_zone = nova {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] storage_protocol = iSCSI {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] syslog_log_facility = LOG_USER {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] target_helper = lioadm {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] target_ip_address = 192.168.122.42 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] target_port = 3260 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] target_protocol = iscsi {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] target_secondary_ip_addresses = [] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] trace_flags = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] transport_url = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] until_refresh = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] use_chap_auth = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] use_default_quota_class = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] use_journal = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] use_json = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] use_multipath_for_image_xfer = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] use_stderr = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] use_syslog = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] verify_glance_signatures = enabled {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_api_class = cinder.volume.api.API {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_backend_name = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_clear = zero {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_clear_ionice = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_clear_size = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_copy_bps_limit = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_dd_blocksize = 1M {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_name_template = volume-%s {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_service_inithost_offload = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volume_usage_audit_period = month {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] zoning_mode = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_concurrency.disable_process_locking = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.auth_section = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.auth_type = password {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.auth_version = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.cache = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.certfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.include_service_catalog = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.insecure = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.interface = public {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.keyfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_password = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcache_username = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.region_name = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.service_type = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.42/identity {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.backend = dogpile.cache.null {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.backend_argument = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.backend_expiration_time = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.config_prefix = cache.oslo {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.debug_cache_backend = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.enable_retry_client = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.enable_socket_keepalive = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.enabled = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.expiration_time = 600 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.hashclient_retry_attempts = 2 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.memcache_dead_retry = 300 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.memcache_pool_maxsize = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.memcache_sasl_enabled = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.password = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.proxies = [] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.redis_db = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87812]: INFO cinder.volume.manager [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Starting volume driver QuobyteDriver (1.2) Jul 23 03:15:59 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.remotefs [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87812) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.redis_server = localhost:6379 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.retry_attempts = 2 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.retry_delay = 0.0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.socket_keepalive_count = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.socket_keepalive_idle = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.socket_keepalive_interval = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.socket_timeout = 1.0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.tls_allowed_ciphers = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.tls_cafile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.tls_certfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.tls_enabled = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.tls_keyfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cache.username = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] coordination.backend_url = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.asyncio_connection = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.asyncio_slave_connection = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.backend = sqlalchemy {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.connection = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.connection_debug = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.connection_parameters = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.connection_recycle_time = 3600 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.connection_trace = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.db_inc_retry_interval = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.db_max_retries = 20 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.db_max_retry_interval = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.db_retry_interval = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.max_overflow = 50 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.max_pool_size = 5 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.max_retries = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.mysql_wsrep_sync_wait = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.pool_timeout = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.retry_interval = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.slave_connection = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.sqlite_synchronous = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.synchronous_reader = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] database.use_db_reconnect = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler.connection_string = messaging:// {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler.enabled = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler.es_doc_type = notification {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler.es_scroll_size = 10000 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler.es_scroll_time = 2m {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler.filter_error_trace = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler.hmac_keys = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler.sentinel_service_name = mymaster {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler.socket_timeout = 0.1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler.trace_requests = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler.trace_sqlalchemy = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler_jaeger.process_tags = {} {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler_jaeger.service_name_prefix = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] profiler_otlp.service_name_prefix = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_policy.enforce_new_defaults = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_policy.policy_default_rule = default {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_policy.policy_file = policy.yaml {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] privsep_osbrick.group = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] privsep_osbrick.helper_command = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] privsep_osbrick.user = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cinder_sys_admin.group = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cinder_sys_admin.helper_command = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] cinder_sys_admin.user = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] service_user.auth_section = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] service_user.auth_type = password {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] service_user.cafile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] service_user.certfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] service_user.collect_timing = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] service_user.insecure = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] service_user.keyfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] service_user.send_service_user_token = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] service_user.split_loggers = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] service_user.timeout = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance.auth_section = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance.auth_type = password {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance.certfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance.collect_timing = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance.insecure = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance.keyfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance.region_name = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance.split_loggers = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] glance.timeout = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.backend_availability_zone = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.chap_password = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.chap_username = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.disk_geometry = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.driver_client_cert = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.driver_client_cert_key = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.driver_data_namespace = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.driver_use_ssl = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.extra_capabilities = {} {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.filter_function = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.goodness_function = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.iscsi_target_flags = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.iscsi_write_cache = on {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.iser_helper = tgtadm {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.iser_ip_address = 192.168.122.42 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.iser_port = 3260 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nas_host = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nas_login = admin {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nas_mount_options = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nas_password = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nas_private_key = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nas_share_path = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.num_shell_tries = 3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.quobyte_volume_url = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.replication_device = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.report_discard_supported = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.reserved_percentage = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.target_helper = tgtadm {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.target_ip_address = 192.168.122.42 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.target_port = 3260 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.target_protocol = iscsi {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.trace_flags = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.unique_fqdn_network = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.use_chap_auth = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.volume_backend_name = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.volume_clear = zero {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.volume_clear_ionice = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.volume_clear_size = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_reports.file_event_handler = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_reports.log_dir = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.backend_availability_zone = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.backend_host = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.chap_password = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.chap_username = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.chiscsi_conf = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.disk_geometry = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.driver_client_cert = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.driver_data_namespace = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.driver_use_ssl = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.extra_capabilities = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.filter_function = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.goodness_function = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.iser_helper = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.iser_ip_address = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.iser_port = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.iser_target_prefix = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nas_host = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nas_login = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nas_mount_options = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nas_password = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nas_private_key = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nas_share_path = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nas_ssh_port = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.num_shell_tries = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.nvmet_port_id = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.replication_device = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.report_discard_supported = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.reserved_percentage = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.scst_target_driver = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.storage_protocol = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.target_helper = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.target_ip_address = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.target_port = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.target_prefix = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.target_protocol = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.trace_flags = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.use_chap_auth = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.volume_clear = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.volume_clear_size = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] QuobyteHD.volumes_dir = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87812) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 23 03:15:59 devstack cinder-volume[87812]: WARNING cinder.volume.drivers.quobyte [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 23 03:15:59 devstack cinder-volume[87812]: WARNING cinder.volume.drivers.quobyte [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Running cmd (subprocess): mount.quobyte {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.ssl = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_notifications.driver = [] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_notifications.retry = -1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] key_manager.fixed_key = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.barbican_api_version = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.barbican_endpoint = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.barbican_endpoint_type = public {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.barbican_region_name = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.cafile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.certfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.collect_timing = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.insecure = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.keyfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.number_of_retries = 60 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.retry_delay = 1 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.send_service_user_token = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.split_loggers = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.timeout = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.verify_ssl = True {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican.verify_ssl_path = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican_service_user.auth_section = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican_service_user.auth_type = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican_service_user.cafile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican_service_user.certfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican_service_user.collect_timing = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican_service_user.insecure = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican_service_user.keyfile = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican_service_user.split_loggers = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] barbican_service_user.timeout = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.approle_role_id = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.approle_secret_id = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.auth_method = approle {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.auth_path = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.kv_mountpoint = secret {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.kv_path = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.kv_version = 2 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.namespace = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.root_token_id = **** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.ssl_ca_crt_file = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.timeout = 60.0 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.token_file = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.token_role = None {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.use_ssl = False {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:15:59 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] ******************************************************************************** {{(pid=87597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 03:15:59 devstack quobyte-client[87815]: Reading configuration file: /etc/quobyte/client.cfg Jul 23 03:15:59 devstack quobyte-client[87815]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 23 03:15:59 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:15:59 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:15:59 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:15:59 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=87812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:15:59 devstack cinder-volume[87812]: INFO cinder.volume.drivers.quobyte [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 ... Jul 23 03:15:59 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 -c /etc/quobyte/client-cinder.cfg {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:15:59 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 -c /etc/quobyte/client-cinder.cfg Jul 23 03:15:59 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:00 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.355s {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:00 devstack cinder-volume[87812]: INFO cinder.volume.drivers.quobyte [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 succeeded Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=87812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.366s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:00 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:16:00 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:00 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.238s {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:00 devstack cinder-volume[87812]: INFO cinder.volume.driver [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Driver hasn't implemented _init_vendor_properties() Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG cinder.volume.driver [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87812) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_db.sqlalchemy.engines [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87812) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG dbcounter [-] [87812] Writer thread running {{(pid=87812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG cinder.db.api [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Building query based on filter {{(pid=87812) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG cinder.image.image_utils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87812) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 03:16:00 devstack cinder-volume[87812]: INFO cinder.keymgr.migration [None req-fc2cb55b-68ea-477a-8435-7189665c9274 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=87812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=87812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:00 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:16:00 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:00 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.237s {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG cinder.manager [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Notifying Schedulers of capabilities ... {{(pid=87812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:16:00 devstack cinder-volume[87812]: INFO cinder.volume.manager [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Driver initialization completed successfully. Jul 23 03:16:00 devstack cinder-volume[87812]: INFO cinder.manager [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Initiating service 3 cleanup Jul 23 03:16:00 devstack cinder-volume[87812]: INFO cinder.manager [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Service 3 cleanup completed. Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG cinder.service [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Creating RPC server for service cinder-volume {{(pid=87812) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG cinder.service [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87812) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 03:16:00 devstack cinder-volume[87812]: INFO cinder.volume.manager [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=87812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=87812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:00 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:00 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:16:00 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:01 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:01 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.285s {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:01 devstack cinder-volume[87812]: INFO cinder.volume.manager [None req-c300cb5f-5b4c-4231-9d28-db5422cc74f4 None None] Driver post RPC initialization completed successfully. Jul 23 03:16:05 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-25a7ca56-e74b-41c0-8a93-a94a6051f309 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:05 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-25a7ca56-e74b-41c0-8a93-a94a6051f309 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:05 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-25a7ca56-e74b-41c0-8a93-a94a6051f309 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=87812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:05 devstack cinder-volume[87812]: DEBUG cinder.volume.drivers.quobyte [None req-25a7ca56-e74b-41c0-8a93-a94a6051f309 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=87812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:05 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-25a7ca56-e74b-41c0-8a93-a94a6051f309 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:05 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-25a7ca56-e74b-41c0-8a93-a94a6051f309 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:05 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:16:05 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:05 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:05 devstack cinder-volume[87812]: DEBUG oslo_concurrency.processutils [None req-25a7ca56-e74b-41c0-8a93-a94a6051f309 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.230s {{(pid=87812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:05 devstack cinder-volume[87812]: DEBUG cinder.manager [None req-25a7ca56-e74b-41c0-8a93-a94a6051f309 None None] Notifying Schedulers of capabilities ... {{(pid=87812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:16:06 devstack cinder-volume[87597]: INFO oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Caught SIGTERM, stopping children Jul 23 03:16:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Acquiring lock "singleton_lock" {{(pid=87597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Acquired lock "singleton_lock" {{(pid=87597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:06 devstack cinder-volume[87597]: DEBUG oslo_concurrency.lockutils [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Releasing lock "singleton_lock" {{(pid=87597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:06 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Stop services. {{(pid=87597) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 23 03:16:06 devstack cinder-volume[87597]: DEBUG oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Killing children. {{(pid=87597) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 23 03:16:06 devstack cinder-volume[87597]: INFO oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Waiting on 1 children to exit Jul 23 03:16:09 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Acquiring lock "singleton_lock" {{(pid=87812) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:09 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Acquired lock "singleton_lock" {{(pid=87812) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:09 devstack cinder-volume[87812]: DEBUG oslo_concurrency.lockutils [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Releasing lock "singleton_lock" {{(pid=87812) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:09 devstack cinder-volume[87812]: WARNING amqp [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:16:09 devstack cinder-volume[87812]: WARNING amqp [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 03:16:09 devstack cinder-volume[87597]: INFO oslo_service.backend._eventlet.service [None req-c0e5d034-cd9a-45c1-9178-ea5a2de87b47 None None] Child 87812 exited with status 0 Jul 23 03:16:09 devstack cinder-volume[88093]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 03:16:09 devstack cinder-volume[88093]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:16:09 devstack cinder-volume[88093]: we strongly recommend against using it for new projects. Jul 23 03:16:09 devstack cinder-volume[88093]: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:16:09 devstack cinder-volume[88093]: framework. For more detail see Jul 23 03:16:09 devstack cinder-volume[88093]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:16:09 devstack cinder-volume[88093]: import eventlet # noqa Jul 23 03:16:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 03:16:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 03:16:13 devstack cinder-volume[88093]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 03:16:14 devstack cinder-volume[88093]: INFO dbcounter [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Registered counter for database cinder Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_db.sqlalchemy.engines [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88093) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writer thread running {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:16:14 devstack cinder-volume[88093]: INFO cinder.rpc [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 03:16:14 devstack cinder-volume[88093]: INFO cinder.rpc [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_db.sqlalchemy.engines [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88093) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Determined volume DB was empty at startup. Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG cinder.volume.manager [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88093) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 03:16:14 devstack cinder-volume[88093]: WARNING stevedore.named [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 03:16:14 devstack cinder-volume[88093]: WARNING castellan.key_manager [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:16:14 devstack cinder-volume[88093]: WARNING cinder.keymgr.conf_key_mgr [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 03:16:14 devstack cinder-volume[88093]: INFO cinder.volume.manager [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_db.sqlalchemy.engines [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88093) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:14 devstack cinder-volume[88093]: INFO oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Starting 1 workers Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Started child 88392 {{(pid=88093) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Full set of CONF: {{(pid=88093) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] ******************************************************************************** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] Configuration options gathered from: {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] ================================================================================ {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] allow_availability_zone_fallback = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] allow_compression_on_image_upload = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88392]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] allowed_direct_url_schemes = [] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] api_rate_limit = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] auth_strategy = keystone {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_availability_zone = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_host = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_name = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_stats_polling_interval = 60 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backup_api_class = cinder.backup.api.API {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backup_name_template = backup-%s {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backup_use_same_host = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backup_use_temp_snapshot = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] chap_password = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] chap_username = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cinder_internal_tenant_project_id = 2758fba316ae431ba4bb86f3900d65c5 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cinder_internal_tenant_user_id = 7725001c22894988821c54e1c3b33777 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cluster = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] compression_format = gzip {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] compute_api_class = cinder.compute.nova.API {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] config_dir = [] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] config_source = [] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] control_exchange = openstack {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] debug = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] default_availability_zone = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] default_group_type = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] default_volume_type = QuobyteHD {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] disk_geometry = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] driver_client_cert = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] driver_client_cert_key = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] driver_data_namespace = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] driver_ssl_cert_path = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] driver_ssl_cert_verify = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] driver_use_ssl = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] enable_new_services = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] enable_unsupported_driver = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] enabled_backends = ['QuobyteHD'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] enforce_multipath_for_image_xfer = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] filter_function = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance_api_insecure = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance_api_servers = ['http://192.168.122.42/image'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance_api_ssl_compression = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance_ca_certificates_file = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance_catalog_info = image:glance:publicURL {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance_certfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance_keyfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance_num_retries = 3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance_request_timeout = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] goodness_function = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] graceful_shutdown_timeout = 5 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] group_api_class = cinder.group.api.API {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] host = devstack {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] image_compress_on_upload = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] image_conversion_address_space_limit = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] image_conversion_cpu_limit = 60 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] image_conversion_disable = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] image_upload_use_cinder_backend = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] image_upload_use_internal_tenant = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] image_volume_cache_enabled = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] image_volume_cache_max_count = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] image_volume_cache_max_size_gb = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] init_host_max_objects_retrieval = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] instance_format = [instance: %(uuid)s] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] iscsi_target_flags = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] iscsi_write_cache = on {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] iser_helper = tgtadm {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] iser_ip_address = 192.168.122.42 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] iser_port = 3260 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] log_color = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] log_config_append = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] log_dir = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] log_file = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] log_options = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] log_rotate_interval = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] log_rotate_interval_type = days {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] log_rotation_type = none {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] max_age = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] max_logfile_count = 30 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] max_logfile_size_mb = 200 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] max_over_subscription_ratio = 20.0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] message_reap_interval = 86400 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] message_ttl = 2592000 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] migration_create_volume_timeout_secs = 300 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] monkey_patch = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] monkey_patch_modules = [] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] my_ip = 192.168.122.42 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] no_snapshot_gb_quota = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Starting volume driver QuobyteDriver (1.2) Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] num_iser_scan_tries = 3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88392) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] num_shell_tries = 3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] num_volume_device_scan_tries = 3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] nvmeof_conn_info_version = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] nvmet_ns_id = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] nvmet_port_id = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] osapi_max_limit = 1000 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] osapi_volume_ext_list = [] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] osapi_volume_listen_port = 8776 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] osapi_volume_use_ssl = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] osapi_volume_workers = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] per_volume_size_limit = -1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] periodic_fuzzy_delay = 60 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] periodic_interval = 60 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] public_endpoint = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] publish_errors = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] quota_backup_gigabytes = 1000 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] quota_backups = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] quota_gigabytes = 1000 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] quota_groups = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] quota_snapshots = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] quota_volumes = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] rate_limit_burst = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] rate_limit_except_level = CRITICAL {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] rate_limit_interval = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] reinit_driver_count = 3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] replication_device = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] report_discard_supported = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] report_interval = 120 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] reservation_clean_interval = 86400 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] reservation_expire = 86400 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] reserved_image_namespaces = [] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] reserved_percentage = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] rpc_response_timeout = 120 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] run_external_periodic_tasks = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] scst_target_driver = iscsi {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] scst_target_iqn_name = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] service_down_time = 720 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] shell_completion = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] snapshot_name_template = snapshot-%s {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] split_loggers = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] state_path = /opt/stack/data/cinder {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] storage_availability_zone = nova {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] storage_protocol = iSCSI {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] syslog_log_facility = LOG_USER {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] target_helper = lioadm {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] target_ip_address = 192.168.122.42 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] target_port = 3260 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] target_protocol = iscsi {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] target_secondary_ip_addresses = [] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] trace_flags = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] transport_url = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] until_refresh = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] use_chap_auth = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] use_default_quota_class = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] use_journal = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] use_json = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] use_multipath_for_image_xfer = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] use_stderr = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] use_syslog = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] verify_glance_signatures = enabled {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_api_class = cinder.volume.api.API {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_backend_name = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_clear = zero {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_clear_ionice = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_clear_size = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_copy_bps_limit = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_dd_blocksize = 1M {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_name_template = volume-%s {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_service_inithost_offload = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volume_usage_audit_period = month {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] zoning_mode = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_concurrency.disable_process_locking = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.auth_section = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.auth_type = password {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.auth_version = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.cache = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.certfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.include_service_catalog = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.insecure = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.interface = public {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.keyfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_password = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcache_username = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.region_name = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.service_type = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.42/identity {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.backend = dogpile.cache.null {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.backend_argument = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.backend_expiration_time = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.config_prefix = cache.oslo {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.debug_cache_backend = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.enable_retry_client = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.enable_socket_keepalive = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.enabled = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.expiration_time = 600 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88392) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 23 03:16:14 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.quobyte [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 23 03:16:14 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.quobyte [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.hashclient_retry_attempts = 2 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.memcache_dead_retry = 300 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.memcache_pool_maxsize = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Running cmd (subprocess): mount.quobyte {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.memcache_sasl_enabled = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.password = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.proxies = [] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.redis_db = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.redis_server = localhost:6379 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.retry_attempts = 2 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.retry_delay = 0.0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.socket_keepalive_count = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.socket_keepalive_idle = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.socket_keepalive_interval = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.socket_timeout = 1.0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.tls_allowed_ciphers = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.tls_cafile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.tls_certfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.tls_enabled = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.tls_keyfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cache.username = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] coordination.backend_url = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.asyncio_connection = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.asyncio_slave_connection = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.backend = sqlalchemy {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.connection = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.connection_debug = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.connection_parameters = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.connection_recycle_time = 3600 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.connection_trace = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.db_inc_retry_interval = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.db_max_retries = 20 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.db_max_retry_interval = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.db_retry_interval = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.max_overflow = 50 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.max_pool_size = 5 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.max_retries = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.mysql_wsrep_sync_wait = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.pool_timeout = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.retry_interval = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.slave_connection = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.sqlite_synchronous = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.synchronous_reader = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] database.use_db_reconnect = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler.connection_string = messaging:// {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler.enabled = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler.es_doc_type = notification {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler.es_scroll_size = 10000 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler.es_scroll_time = 2m {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler.filter_error_trace = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler.hmac_keys = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler.sentinel_service_name = mymaster {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler.socket_timeout = 0.1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler.trace_requests = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler.trace_sqlalchemy = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler_jaeger.process_tags = {} {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler_jaeger.service_name_prefix = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] profiler_otlp.service_name_prefix = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_policy.enforce_new_defaults = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_policy.policy_default_rule = default {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_policy.policy_file = policy.yaml {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] privsep_osbrick.group = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] privsep_osbrick.helper_command = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] privsep_osbrick.user = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cinder_sys_admin.group = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cinder_sys_admin.helper_command = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] cinder_sys_admin.user = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] service_user.auth_section = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] service_user.auth_type = password {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] service_user.cafile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] service_user.certfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] service_user.collect_timing = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] service_user.insecure = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] service_user.keyfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] service_user.send_service_user_token = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] service_user.split_loggers = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] service_user.timeout = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance.auth_section = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance.auth_type = password {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance.certfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance.collect_timing = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance.insecure = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance.keyfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance.region_name = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance.split_loggers = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] glance.timeout = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.backend_availability_zone = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.chap_password = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.chap_username = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.disk_geometry = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.driver_client_cert = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.driver_client_cert_key = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.driver_data_namespace = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.driver_use_ssl = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.extra_capabilities = {} {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.filter_function = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.goodness_function = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.iscsi_target_flags = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.iscsi_write_cache = on {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.iser_helper = tgtadm {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.iser_ip_address = 192.168.122.42 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.iser_port = 3260 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nas_host = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nas_login = admin {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nas_mount_options = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nas_password = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nas_private_key = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nas_share_path = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.num_shell_tries = 3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.quobyte_volume_url = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.replication_device = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.report_discard_supported = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.reserved_percentage = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.target_helper = tgtadm {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.target_ip_address = 192.168.122.42 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.target_port = 3260 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.target_protocol = iscsi {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.trace_flags = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.unique_fqdn_network = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.use_chap_auth = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.volume_backend_name = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.volume_clear = zero {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.volume_clear_ionice = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.volume_clear_size = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_reports.file_event_handler = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_reports.log_dir = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack quobyte-client[88393]: Reading configuration file: /etc/quobyte/client.cfg Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.backend_availability_zone = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.backend_host = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack quobyte-client[88393]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.chap_password = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.chap_username = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.chiscsi_conf = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.disk_geometry = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.driver_client_cert = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.driver_data_namespace = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.driver_use_ssl = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.extra_capabilities = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.filter_function = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.goodness_function = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.iser_helper = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.iser_ip_address = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.iser_port = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.iser_target_prefix = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nas_host = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nas_login = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nas_mount_options = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nas_password = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nas_private_key = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nas_share_path = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nas_ssh_port = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.num_shell_tries = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.nvmet_port_id = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.replication_device = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.report_discard_supported = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.reserved_percentage = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.scst_target_driver = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.storage_protocol = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.target_helper = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.target_ip_address = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.target_port = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.target_prefix = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.target_protocol = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.trace_flags = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.use_chap_auth = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.volume_clear = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.volume_clear_size = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] QuobyteHD.volumes_dir = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.ssl = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_notifications.driver = [] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_notifications.retry = -1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] key_manager.fixed_key = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.barbican_api_version = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.barbican_endpoint = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.barbican_endpoint_type = public {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.barbican_region_name = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.cafile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.certfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.collect_timing = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.insecure = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.keyfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.number_of_retries = 60 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.retry_delay = 1 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.send_service_user_token = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.split_loggers = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.timeout = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.verify_ssl = True {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican.verify_ssl_path = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican_service_user.auth_section = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican_service_user.auth_type = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican_service_user.cafile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican_service_user.certfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican_service_user.collect_timing = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican_service_user.insecure = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican_service_user.keyfile = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican_service_user.split_loggers = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] barbican_service_user.timeout = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.approle_role_id = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.approle_secret_id = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.auth_method = approle {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.auth_path = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.kv_mountpoint = secret {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.kv_path = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.kv_version = 2 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.namespace = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.root_token_id = **** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.ssl_ca_crt_file = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.timeout = 60.0 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.token_file = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.token_role = None {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.use_ssl = False {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 03:16:14 devstack cinder-volume[88093]: DEBUG oslo_service.backend._eventlet.service [None req-55fb7902-8413-4584-86c6-ae005ffcf769 None None] ******************************************************************************** {{(pid=88093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 03:16:15 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.259s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:15 devstack cinder-volume[88392]: INFO cinder.volume.driver [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Driver hasn't implemented _init_vendor_properties() Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG cinder.volume.driver [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88392) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_db.sqlalchemy.engines [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88392) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writer thread running {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG cinder.db.api [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Building query based on filter {{(pid=88392) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88392) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:15 devstack cinder-volume[88392]: INFO cinder.keymgr.migration [None req-72fe79b4-af20-4989-bb15-33eceb3aff10 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 03:16:15 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:16:15 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:15 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.240s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:16:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Driver initialization completed successfully. Jul 23 03:16:15 devstack cinder-volume[88392]: INFO cinder.manager [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Initiating service 3 cleanup Jul 23 03:16:15 devstack cinder-volume[88392]: INFO cinder.manager [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Service 3 cleanup completed. Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG cinder.service [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Creating RPC server for service cinder-volume {{(pid=88392) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG cinder.service [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88392) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 03:16:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:16:15 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:16:15 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:16:15 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Jul 23 03:16:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.239s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:16:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-86289f72-9e61-4ca2-ac05-099ff7e49861 None None] Driver post RPC initialization completed successfully. Jul 23 03:16:24 devstack cinder-volume[88093]: DEBUG dbcounter [-] [88093] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:16:25 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:16:25 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=3 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:17:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:17:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 6 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:17:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:17:23 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:17:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Flow 'volume_create_manager' (d7bab6db-b8c0-480f-a0e1-db9f76bde5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:17:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712042fa-c17c-4ae4-9fca-4467366c4262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712042fa-c17c-4ae4-9fca-4467366c4262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2056474930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857758bf-66af-4ba6-b802-ed31c2a18e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4bb233ed2e7456ab3fb3a3a392985de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:23Z,use_quota=True,user_id='b5cafbcbf79b41689cf585a81ecf5b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffb9778-c6f9-4196-8612-e82d3e2a8c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffb9778-c6f9-4196-8612-e82d3e2a8c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f0a2c0-d550-4e79-8473-57f8eea0371a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f0a2c0-d550-4e79-8473-57f8eea0371a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857758bf-66af-4ba6-b802-ed31c2a18e9d', 'volume_name': 'volume-857758bf-66af-4ba6-b802-ed31c2a18e9d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41be6ffc-8af7-4b07-a7b3-1457d4efa49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41be6ffc-8af7-4b07-a7b3-1457d4efa49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc139ac6-d094-49f0-b19a-b3099cf10b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:24 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Volume 857758bf-66af-4ba6-b802-ed31c2a18e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857758bf-66af-4ba6-b802-ed31c2a18e9d', 'volume_size': 1} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2056474930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857758bf-66af-4ba6-b802-ed31c2a18e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4bb233ed2e7456ab3fb3a3a392985de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:23Z,use_quota=True,user_id='b5cafbcbf79b41689cf585a81ecf5b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Creating volume 857758bf-66af-4ba6-b802-ed31c2a18e9d {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:17:24 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:17:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:24 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d 1073741824 Jul 23 03:17:24 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:26 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d 1073741824" returned: 0 in 2.266s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:26 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d Jul 23 03:17:26 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:27 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d" returned: 0 in 0.776s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] <== create_volume: return (3364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:17:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.390s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc139ac6-d094-49f0-b19a-b3099cf10b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857758bf-66af-4ba6-b802-ed31c2a18e9d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c80872-397a-485b-8072-8f2afa4aa66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:27 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Volume volume-857758bf-66af-4ba6-b802-ed31c2a18e9d (857758bf-66af-4ba6-b802-ed31c2a18e9d): created successfully Jul 23 03:17:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c80872-397a-485b-8072-8f2afa4aa66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Flow 'volume_create_manager' (d7bab6db-b8c0-480f-a0e1-db9f76bde5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:17:27 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4c2c5555-9701-4474-94a7-181718eb563e tempest-DeleteServersTestJSON-562469624 None] Created volume successfully. Jul 23 03:17:35 devstack cinder-volume[88392]: WARNING py.warnings [req-bebd1eaa-e0b6-4b19-bf81-3bafe7773f8d req-d4e59852-b783-48a9-811e-a278d3b0d7ef tempest-DeleteServersTestJSON-562469624 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 23 03:17:35 devstack cinder-volume[88392]: .first() Jul 23 03:17:35 devstack cinder-volume[88392]: Jul 23 03:17:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-bebd1eaa-e0b6-4b19-bf81-3bafe7773f8d req-d4e59852-b783-48a9-811e-a278d3b0d7ef tempest-DeleteServersTestJSON-562469624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-bebd1eaa-e0b6-4b19-bf81-3bafe7773f8d req-d4e59852-b783-48a9-811e-a278d3b0d7ef tempest-DeleteServersTestJSON-562469624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-bebd1eaa-e0b6-4b19-bf81-3bafe7773f8d req-d4e59852-b783-48a9-811e-a278d3b0d7ef tempest-DeleteServersTestJSON-562469624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.189s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Flow 'volume_create_manager' (0d06f8f1-56fc-40c8-baf5-3588c5152cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ceba45f-58fd-4d6d-90d1-b3c1e5a2c897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-bebd1eaa-e0b6-4b19-bf81-3bafe7773f8d req-d4e59852-b783-48a9-811e-a278d3b0d7ef tempest-DeleteServersTestJSON-562469624 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-857758bf-66af-4ba6-b802-ed31c2a18e9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75de7357-840a-4d7b-b9dc-28971d9c27fa', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ceba45f-58fd-4d6d-90d1-b3c1e5a2c897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-781081084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6001747e-8992-4ede-aad8-b46cf0276925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d6bcd4d2364c24a62aa8b2e4a4c9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:36Z,use_quota=True,user_id='9253979899e44edc9bee13e8d7972346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f777d63-adb1-4295-af22-65f14e205f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f777d63-adb1-4295-af22-65f14e205f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58640e9-5f7d-42e1-a119-d5d33ad3925a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58640e9-5f7d-42e1-a119-d5d33ad3925a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6001747e-8992-4ede-aad8-b46cf0276925', 'volume_name': 'volume-6001747e-8992-4ede-aad8-b46cf0276925', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e4a4cb-b4ee-4b38-b93d-1cd9a73096a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e4a4cb-b4ee-4b38-b93d-1cd9a73096a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee4a3d5-c2c5-4c3d-844d-89682c572bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:36 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Volume 6001747e-8992-4ede-aad8-b46cf0276925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6001747e-8992-4ede-aad8-b46cf0276925', 'volume_size': 1} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-781081084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6001747e-8992-4ede-aad8-b46cf0276925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d6bcd4d2364c24a62aa8b2e4a4c9be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:36Z,use_quota=True,user_id='9253979899e44edc9bee13e8d7972346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Creating volume 6001747e-8992-4ede-aad8-b46cf0276925 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:17:36 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:17:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:36 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925 1073741824 Jul 23 03:17:36 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-bebd1eaa-e0b6-4b19-bf81-3bafe7773f8d req-d4e59852-b783-48a9-811e-a278d3b0d7ef tempest-DeleteServersTestJSON-562469624 None] attachment_update completed successfully. Jul 23 03:17:37 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925 1073741824" returned: 0 in 1.289s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:37 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925 Jul 23 03:17:37 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:38 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925" returned: 0 in 0.601s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:17:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee4a3d5-c2c5-4c3d-844d-89682c572bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6001747e-8992-4ede-aad8-b46cf0276925', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bfb32d5-ef3f-48fa-a3af-a11b900698e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:38 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Volume volume-6001747e-8992-4ede-aad8-b46cf0276925 (6001747e-8992-4ede-aad8-b46cf0276925): created successfully Jul 23 03:17:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bfb32d5-ef3f-48fa-a3af-a11b900698e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Flow 'volume_create_manager' (0d06f8f1-56fc-40c8-baf5-3588c5152cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:17:38 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8de94e6c-032a-48c6-9220-ed9271135fdb tempest-VolumesAdminNegativeTest-1816620113 None] Created volume successfully. Jul 23 03:17:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Acquiring lock "cinder-6001747e-8992-4ede-aad8-b46cf0276925-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:17:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Lock "cinder-6001747e-8992-4ede-aad8-b46cf0276925-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:17:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Acquiring lock "cinder-quobyte-6001747e-8992-4ede-aad8-b46cf0276925" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:17:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Lock "cinder-quobyte-6001747e-8992-4ede-aad8-b46cf0276925" acquired by "delete_volume" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:17:40 devstack cinder-volume[88392]: INFO oslo.privsep.daemon [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_59g5mmo/privsep.sock'] Jul 23 03:17:40 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_59g5mmo/privsep.sock Jul 23 03:17:40 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:41 devstack cinder-volume[88392]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 23 03:17:41 devstack cinder-volume[88392]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 03:17:41 devstack cinder-volume[88392]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 23 03:17:41 devstack cinder-volume[88392]: WARNING oslo.privsep.daemon [-] privsep log: Jul 23 03:17:41 devstack cinder-volume[88392]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 23 03:17:41 devstack cinder-volume[88392]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 23 03:17:41 devstack cinder-volume[88392]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 03:17:41 devstack cinder-volume[88392]: WARNING oslo.privsep.daemon [-] privsep log: Jul 23 03:17:41 devstack cinder-volume[88392]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 23 03:17:42 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:42 devstack cinder-volume[88392]: INFO oslo.privsep.daemon [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Spawned new privsep daemon via rootwrap Jul 23 03:17:42 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Accepted privsep connection to /tmp/tmp_59g5mmo/privsep.sock {{(pid=88392) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 23 03:17:42 devstack cinder-volume[88392]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 23 03:17:42 devstack cinder-volume[88392]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 23 03:17:42 devstack cinder-volume[88392]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 23 03:17:42 devstack cinder-volume[88392]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90167 Jul 23 03:17:42 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5947593-865c-4b22-8be3-c5ad5ec91562]: (2,) {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:17:42 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[605a5744-cb12-4053-9288-a75543df73f5]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:17:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:42 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925 Jul 23 03:17:42 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:43 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925" returned: 0 in 0.935s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:43 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925 Jul 23 03:17:43 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:43 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6001747e-8992-4ede-aad8-b46cf0276925" returned: 0 in 0.443s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Lock "cinder-quobyte-6001747e-8992-4ede-aad8-b46cf0276925" released by "delete_volume" :: held 3.552s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:17:43 devstack cinder-volume[88392]: WARNING cinder.quota [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:17:43 devstack cinder-volume[88392]: WARNING cinder.quota [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:17:44 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Created reservations ['bf84ce8c-4d09-4518-a031-431e4f82fe34', '3a8077a0-1687-4c74-a365-e17b7d4b5b8a', 'a6c05a37-13b0-41ee-b3d4-9059fb4d8ed7', 'fcde5597-4bbe-42a9-bca4-7af8fd667d8e'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:17:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:17:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:17:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:44 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:17:44 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:44 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.620s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:44 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:17:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Deleted volume successfully. Jul 23 03:17:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3e620af-dfcd-41db-82d9-b1eb492f596e tempest-VolumesAdminNegativeTest-1816620113 None] Lock "cinder-6001747e-8992-4ede-aad8-b46cf0276925-delete_volume" released by "delete_volume" :: held 4.891s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:17:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-b558e100-ef8e-49b7-b912-024a4cf52d97 req-e69c0647-9d1e-412c-b065-f129fc397000 tempest-DeleteServersTestJSON-562469624 None] Terminate volume connection completed successfully. Jul 23 03:17:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-b558e100-ef8e-49b7-b912-024a4cf52d97 req-e69c0647-9d1e-412c-b065-f129fc397000 tempest-DeleteServersTestJSON-562469624 None] Deleting attachment 75de7357-840a-4d7b-b9dc-28971d9c27fa. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Acquiring lock "cinder-857758bf-66af-4ba6-b802-ed31c2a18e9d-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Flow 'volume_create_manager' (99173da4-5a03-469e-8055-c3c859a7ea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ade1c5-b542-426b-b1e1-c009c1b6c5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ade1c5-b542-426b-b1e1-c009c1b6c5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1285028778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feaed3b2969b47a09dd1bfc50c89d3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:50Z,use_quota=True,user_id='82a98dc6d8784ac283182a5897e7b64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47b4026-fd2f-4c45-9b4d-d35da76c539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47b4026-fd2f-4c45-9b4d-d35da76c539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ce143e-a54d-4063-be9f-eadb235af239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ce143e-a54d-4063-be9f-eadb235af239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4', 'volume_name': 'volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd25e50-ba14-4fca-ac81-3a0d57c3c9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd25e50-ba14-4fca-ac81-3a0d57c3c9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d502b2ad-61f9-4ca4-aa93-b0c52cee397c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:49 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Volume 060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4', 'volume_size': 1} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1285028778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feaed3b2969b47a09dd1bfc50c89d3ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:17:50Z,use_quota=True,user_id='82a98dc6d8784ac283182a5897e7b64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Creating volume 060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:17:49 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Lock "cinder-857758bf-66af-4ba6-b802-ed31c2a18e9d-delete_volume" acquired by "delete_volume" :: waited 0.143s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:17:49 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4 1073741824 Jul 23 03:17:49 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Acquiring lock "cinder-quobyte-857758bf-66af-4ba6-b802-ed31c2a18e9d" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Lock "cinder-quobyte-857758bf-66af-4ba6-b802-ed31c2a18e9d" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1569c1-9369-4609-902e-bf969333807e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:17:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:50 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d Jul 23 03:17:50 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:50 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4 1073741824" returned: 0 in 0.663s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:50 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4 Jul 23 03:17:50 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:50 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d" returned: 0 in 0.786s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:50 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d Jul 23 03:17:50 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:51 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-857758bf-66af-4ba6-b802-ed31c2a18e9d" returned: 0 in 0.352s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Lock "cinder-quobyte-857758bf-66af-4ba6-b802-ed31c2a18e9d" released by "delete_volume" :: held 1.205s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Created reservations ['506af57c-e75e-4f8a-9fd1-330e44e71539', '1a7ba10a-f870-4b8f-b6f9-22b54cc21268', '3d373952-a4ab-45eb-99dc-d07ff7cddc64', '03f6aaff-4422-4449-ac88-0d0a81e215a8'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:17:51 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4" returned: 0 in 0.732s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d502b2ad-61f9-4ca4-aa93-b0c52cee397c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b43945-2967-4d58-8188-e142578ae8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:17:51 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Volume volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4 (060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4): created successfully Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b43945-2967-4d58-8188-e142578ae8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Flow 'volume_create_manager' (99173da4-5a03-469e-8055-c3c859a7ea6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:17:51 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d6ce6e98-ba37-46e5-9035-210d459ccf2a tempest-ServerRescueNegativeTestJSON-321196915 None] Created volume successfully. Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:17:51 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:17:51 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:17:51 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.308s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:17:51 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Deleted volume successfully. Jul 23 03:17:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b3389f6b-2e74-4f32-97dd-5dddd152f593 tempest-DeleteServersTestJSON-562469624 None] Lock "cinder-857758bf-66af-4ba6-b802-ed31c2a18e9d-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:18:01 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=23,cinder:INSERT=6,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:01 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=25,cinder:SELECT=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:18:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:18:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:18:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:06 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:18:06 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:07 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.364s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:18:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:18:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 8 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:18:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:18:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Acquiring lock "cinder-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:18:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Lock "cinder-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:18:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Acquiring lock "cinder-quobyte-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:18:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Lock "cinder-quobyte-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:18:22 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5addfdc-657b-4ad9-8a41-4af05a4a2ffd]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:18:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:22 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4 Jul 23 03:18:22 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:23 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4" returned: 0 in 0.421s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:23 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4 Jul 23 03:18:23 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:23 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4" returned: 0 in 0.471s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Lock "cinder-quobyte-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4" released by "delete_volume" :: held 0.945s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:18:23 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Created reservations ['1fbd77eb-1183-419c-b2e7-26fd50be718b', '30b80561-4a9d-4fed-88a5-a3d71d0c8bac', 'cc5877e2-2528-40e1-9f3f-8c7a2acdd17e', 'adacfa5d-588d-4b64-b176-bedbffa88485'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:18:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:18:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:18:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:23 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:18:23 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:24 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.431s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:24 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:18:24 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Deleted volume successfully. Jul 23 03:18:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-90526c60-9545-4ad9-bac4-15acd25fb87f tempest-ServerRescueNegativeTestJSON-321196915 None] Lock "cinder-060faa7e-ed2b-41bf-a6bc-3f7009c9a8d4-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:18:33 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=12,cinder:SELECT=5,cinder:INSERT=3 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:34 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Flow 'volume_create_manager' (67f5dc4c-cf3f-40d5-9074-7ca6fa4ff737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec82d56-389e-4be7-8a3f-b2d88fbaff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec82d56-389e-4be7-8a3f-b2d88fbaff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2121376663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af8f9a2-34e2-4cb8-9090-20f5e803d104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e016bd164ed24d658165c9dca660be07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:46Z,use_quota=True,user_id='d736519a7de54a6db0dc3e0ab5fe7d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f096f7ae-6b8d-4ec2-8079-1319cdd6c59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f096f7ae-6b8d-4ec2-8079-1319cdd6c59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61638c4-2312-455c-a8c5-7a5353441b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61638c4-2312-455c-a8c5-7a5353441b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af8f9a2-34e2-4cb8-9090-20f5e803d104', 'volume_name': 'volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e2b647-3bf7-4bcb-a3c3-447d14a51728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e2b647-3bf7-4bcb-a3c3-447d14a51728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186a6cc9-784c-41cb-b267-cd66ebe12931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:46 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Volume 6af8f9a2-34e2-4cb8-9090-20f5e803d104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104', 'volume_size': 1} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2121376663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af8f9a2-34e2-4cb8-9090-20f5e803d104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e016bd164ed24d658165c9dca660be07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:18:46Z,use_quota=True,user_id='d736519a7de54a6db0dc3e0ab5fe7d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Creating volume 6af8f9a2-34e2-4cb8-9090-20f5e803d104 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:18:46 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:46 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104 1073741824 Jul 23 03:18:46 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:46 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104 1073741824" returned: 0 in 0.638s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:18:46 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104 Jul 23 03:18:46 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:18:47 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Jul 23 03:18:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104" returned: 0 in 0.352s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:18:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:18:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:18:47 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186a6cc9-784c-41cb-b267-cd66ebe12931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:47 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61fbed3b-f05f-49ca-97b2-4c241f71c05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:18:47 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Volume volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104 (6af8f9a2-34e2-4cb8-9090-20f5e803d104): created successfully Jul 23 03:18:47 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61fbed3b-f05f-49ca-97b2-4c241f71c05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:18:47 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Flow 'volume_create_manager' (67f5dc4c-cf3f-40d5-9074-7ca6fa4ff737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:18:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4ba468fc-2963-4c6b-8275-135d1d1fbcf8 tempest-TaggedAttachmentsTest-1284948248 None] Created volume successfully. Jul 23 03:18:57 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:18:57 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:19:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:19:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:06 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:19:06 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:07 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.465s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:19:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:19:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 8 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:19:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Flow 'volume_create_manager' (c68d5562-144e-469a-81ce-3ad1064998c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b300c50f-38aa-4005-8b06-a5d3ba204fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b300c50f-38aa-4005-8b06-a5d3ba204fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-672746207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21de5c4-3419-4380-9e3e-58048ec17832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1bf81fbf1c49a9a126606ec413e2db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:21Z,use_quota=True,user_id='0f21af0d77224ff5846fedf81eb24ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007f3d3f-4420-4990-b047-3cb6a8d8175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007f3d3f-4420-4990-b047-3cb6a8d8175b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b20744f-105c-432d-942a-0d8810adebd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b20744f-105c-432d-942a-0d8810adebd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21de5c4-3419-4380-9e3e-58048ec17832', 'volume_name': 'volume-f21de5c4-3419-4380-9e3e-58048ec17832', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91887609-2422-4041-a23a-f0afedc0c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91887609-2422-4041-a23a-f0afedc0c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aaac5e-81ca-4f7e-96bd-a22217ee21c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:21 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Volume f21de5c4-3419-4380-9e3e-58048ec17832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21de5c4-3419-4380-9e3e-58048ec17832', 'volume_size': 1} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-672746207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21de5c4-3419-4380-9e3e-58048ec17832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1bf81fbf1c49a9a126606ec413e2db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:21Z,use_quota=True,user_id='0f21af0d77224ff5846fedf81eb24ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Creating volume f21de5c4-3419-4380-9e3e-58048ec17832 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:19:21 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:19:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:21 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832 1073741824 Jul 23 03:19:21 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:22 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832 1073741824" returned: 0 in 0.844s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:22 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832 Jul 23 03:19:22 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:22 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832" returned: 0 in 0.537s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:19:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aaac5e-81ca-4f7e-96bd-a22217ee21c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21de5c4-3419-4380-9e3e-58048ec17832', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf3ad1b-334d-49ab-af21-ab1e9a15f97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:22 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Volume volume-f21de5c4-3419-4380-9e3e-58048ec17832 (f21de5c4-3419-4380-9e3e-58048ec17832): created successfully Jul 23 03:19:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf3ad1b-334d-49ab-af21-ab1e9a15f97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Flow 'volume_create_manager' (c68d5562-144e-469a-81ce-3ad1064998c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:22 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-286f5e6e-4faa-4ec3-bd1d-86799d5753c4 tempest-ServersNegativeTestJSON-2072953095 None] Created volume successfully. Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Flow 'volume_create_manager' (ed5b359f-4856-4312-a319-d513cbd69505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e8593e-381e-4fd2-8240-09eb79073fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e8593e-381e-4fd2-8240-09eb79073fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1694782268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90004529-a948-4e49-8e14-b6176271678c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525f087e6f2445c9ac16f6cbb0d03dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:23Z,use_quota=True,user_id='018dcfb89f264e67a075f5fd27a26a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ba5023-2ca2-4a0c-8c4a-1b1b973696c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ba5023-2ca2-4a0c-8c4a-1b1b973696c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06aecbbb-9efe-4450-8c81-063089b3dd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06aecbbb-9efe-4450-8c81-063089b3dd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90004529-a948-4e49-8e14-b6176271678c', 'volume_name': 'volume-90004529-a948-4e49-8e14-b6176271678c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f359ebe-11c8-45e7-aab9-875bf57e1edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f359ebe-11c8-45e7-aab9-875bf57e1edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6205c06-f7ed-48ac-9831-9b44380580ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:23 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Volume 90004529-a948-4e49-8e14-b6176271678c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90004529-a948-4e49-8e14-b6176271678c', 'volume_size': 1} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1694782268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90004529-a948-4e49-8e14-b6176271678c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525f087e6f2445c9ac16f6cbb0d03dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:23Z,use_quota=True,user_id='018dcfb89f264e67a075f5fd27a26a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Creating volume 90004529-a948-4e49-8e14-b6176271678c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:19:23 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:23 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c 1073741824 Jul 23 03:19:23 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:23 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c 1073741824" returned: 0 in 0.567s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:23 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c Jul 23 03:19:23 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c" returned: 0 in 0.439s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:19:24 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6205c06-f7ed-48ac-9831-9b44380580ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90004529-a948-4e49-8e14-b6176271678c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24059f46-ea4a-41e8-a9c1-387500085da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:24 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Volume volume-90004529-a948-4e49-8e14-b6176271678c (90004529-a948-4e49-8e14-b6176271678c): created successfully Jul 23 03:19:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24059f46-ea4a-41e8-a9c1-387500085da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Flow 'volume_create_manager' (ed5b359f-4856-4312-a319-d513cbd69505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:24 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e45953ef-ef04-4977-a2bf-5b613128d91d tempest-AttachVolumeTestJSON-211150349 None] Created volume successfully. Jul 23 03:19:25 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:19:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Flow 'volume_create_manager' (0f582029-cb1b-4f1b-bb76-13a548f8acc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f71f4b-e2f4-4f7b-a7b6-ecab03b9d3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f71f4b-e2f4-4f7b-a7b6-ecab03b9d3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1266673222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d403477-dacb-43a6-9e46-22530c72938f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1bf81fbf1c49a9a126606ec413e2db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:26Z,use_quota=True,user_id='0f21af0d77224ff5846fedf81eb24ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b13ba9-0002-406a-8108-31410bfc1924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b13ba9-0002-406a-8108-31410bfc1924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c7888e-1421-4ac9-bccb-e312e26f302b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c7888e-1421-4ac9-bccb-e312e26f302b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d403477-dacb-43a6-9e46-22530c72938f', 'volume_name': 'volume-3d403477-dacb-43a6-9e46-22530c72938f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bd71df-303f-4109-9c8d-14fdca306b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bd71df-303f-4109-9c8d-14fdca306b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf08795b-c46f-4920-bbba-66364e29e152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:26 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Volume 3d403477-dacb-43a6-9e46-22530c72938f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d403477-dacb-43a6-9e46-22530c72938f', 'volume_size': 1} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1266673222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d403477-dacb-43a6-9e46-22530c72938f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1bf81fbf1c49a9a126606ec413e2db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:26Z,use_quota=True,user_id='0f21af0d77224ff5846fedf81eb24ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Creating volume 3d403477-dacb-43a6-9e46-22530c72938f {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:19:26 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:26 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f 1073741824 Jul 23 03:19:26 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-d7c2f89d-c038-465d-8ee0-7d0cb7354a7a req-bf19f3ca-dfa1-488d-b887-c6bb86b6ef35 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:26 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f 1073741824" returned: 0 in 0.721s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:26 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f Jul 23 03:19:26 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:27 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f" returned: 0 in 0.282s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:19:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-d7c2f89d-c038-465d-8ee0-7d0cb7354a7a req-bf19f3ca-dfa1-488d-b887-c6bb86b6ef35 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.406s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf08795b-c46f-4920-bbba-66364e29e152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d403477-dacb-43a6-9e46-22530c72938f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2280f142-510e-4568-842a-f2c546226151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-d7c2f89d-c038-465d-8ee0-7d0cb7354a7a req-bf19f3ca-dfa1-488d-b887-c6bb86b6ef35 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:27 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Volume volume-3d403477-dacb-43a6-9e46-22530c72938f (3d403477-dacb-43a6-9e46-22530c72938f): created successfully Jul 23 03:19:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2280f142-510e-4568-842a-f2c546226151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Flow 'volume_create_manager' (0f582029-cb1b-4f1b-bb76-13a548f8acc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:27 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a7e9db5f-c8b4-4c48-bbd7-ab9caa104ca9 tempest-ServersNegativeTestJSON-2072953095 None] Created volume successfully. Jul 23 03:19:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-d7c2f89d-c038-465d-8ee0-7d0cb7354a7a req-bf19f3ca-dfa1-488d-b887-c6bb86b6ef35 tempest-AttachVolumeTestJSON-211150349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-90004529-a948-4e49-8e14-b6176271678c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26918274-b624-46ca-9127-c2abdf5b54d4', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:19:27 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-d7c2f89d-c038-465d-8ee0-7d0cb7354a7a req-bf19f3ca-dfa1-488d-b887-c6bb86b6ef35 tempest-AttachVolumeTestJSON-211150349 None] attachment_update completed successfully. Jul 23 03:19:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Acquiring lock "cinder-3d403477-dacb-43a6-9e46-22530c72938f-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Lock "cinder-3d403477-dacb-43a6-9e46-22530c72938f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Acquiring lock "cinder-quobyte-3d403477-dacb-43a6-9e46-22530c72938f" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Lock "cinder-quobyte-3d403477-dacb-43a6-9e46-22530c72938f" acquired by "delete_volume" :: waited 0.038s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:29 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec68086-f456-4ebc-ac2e-af1d589102bb]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:19:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:29 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f Jul 23 03:19:29 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:29 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f" returned: 0 in 0.639s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:29 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f Jul 23 03:19:29 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:30 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3d403477-dacb-43a6-9e46-22530c72938f" returned: 0 in 0.411s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Lock "cinder-quobyte-3d403477-dacb-43a6-9e46-22530c72938f" released by "delete_volume" :: held 1.130s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Created reservations ['4ac32049-8b07-439a-90ce-6b0ce1913958', '7ea99e43-491b-4e8d-941a-73b8adafa3bc', '87accddf-14c9-4224-ab73-e6b93f4b3acc', '9af14409-de36-4d6a-90af-c18b818bcf05'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:30 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:19:30 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:30 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.247s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:19:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Deleted volume successfully. Jul 23 03:19:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ccba946-c68d-46bd-94b7-d711eb61def7 tempest-ServersNegativeTestJSON-2072953095 None] Lock "cinder-3d403477-dacb-43a6-9e46-22530c72938f-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Acquiring lock "cinder-f21de5c4-3419-4380-9e3e-58048ec17832-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Lock "cinder-f21de5c4-3419-4380-9e3e-58048ec17832-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Acquiring lock "cinder-quobyte-f21de5c4-3419-4380-9e3e-58048ec17832" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:19:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Lock "cinder-quobyte-f21de5c4-3419-4380-9e3e-58048ec17832" acquired by "delete_volume" :: waited 0.033s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:19:31 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[23418941-369a-4e0a-8a13-124fe6a8e253]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:19:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:31 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832 Jul 23 03:19:31 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:31 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832" returned: 0 in 0.471s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:31 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832 Jul 23 03:19:31 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:32 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f21de5c4-3419-4380-9e3e-58048ec17832" returned: 0 in 0.295s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Lock "cinder-quobyte-f21de5c4-3419-4380-9e3e-58048ec17832" released by "delete_volume" :: held 0.836s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:32 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Created reservations ['7d7bb101-0536-4605-a1d3-ecc9203f506d', '178e44d4-a58f-4c85-8025-21fde1d7d1d1', 'e8f55af2-9133-4f26-abfd-cd112ac3f97c', '9333bd1e-c3f8-49b2-bbfc-98b14ac97ea6'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:19:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:32 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:19:32 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:32 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.362s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:33 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:19:33 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Deleted volume successfully. Jul 23 03:19:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dad2f72d-0152-4873-99ea-3374925dc4cb tempest-ServersNegativeTestJSON-2072953095 None] Lock "cinder-f21de5c4-3419-4380-9e3e-58048ec17832-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:19:42 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=25,cinder:SELECT=25,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:19:43 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=20,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=7 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:19:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e8cf3453-a66d-4550-85a0-5b520f443fe1 tempest-GroupsV320Test-1413115282 None] Group tempest-GroupsV320Test-Group-1099603855: creating Jul 23 03:19:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e8cf3453-a66d-4550-85a0-5b520f443fe1 tempest-GroupsV320Test-1413115282 None] Group tempest-GroupsV320Test-Group-1099603855: created successfully Jul 23 03:19:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e8cf3453-a66d-4550-85a0-5b520f443fe1 tempest-GroupsV320Test-1413115282 None] Create group completed successfully. Jul 23 03:19:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-3d2cd7ec-e677-44a4-9ca2-2fe237cf498c req-09283315-f303-41f3-bbea-6cb1e5104d3b tempest-TaggedAttachmentsTest-1284948248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-3d2cd7ec-e677-44a4-9ca2-2fe237cf498c req-09283315-f303-41f3-bbea-6cb1e5104d3b tempest-TaggedAttachmentsTest-1284948248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-3d2cd7ec-e677-44a4-9ca2-2fe237cf498c req-09283315-f303-41f3-bbea-6cb1e5104d3b tempest-TaggedAttachmentsTest-1284948248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-3d2cd7ec-e677-44a4-9ca2-2fe237cf498c req-09283315-f303-41f3-bbea-6cb1e5104d3b tempest-TaggedAttachmentsTest-1284948248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1c45a55-2e28-4e00-9b59-0f4d15ff52e5', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:19:48 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-3d2cd7ec-e677-44a4-9ca2-2fe237cf498c req-09283315-f303-41f3-bbea-6cb1e5104d3b tempest-TaggedAttachmentsTest-1284948248 None] attachment_update completed successfully. Jul 23 03:19:49 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-5fe5d38b-e487-4f35-a440-32258562fe86 tempest-GroupsV320Test-1413115282 None] Created reservations ['04188fa4-404f-4ff4-84a1-cc35e32e4bbc'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:19:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5fe5d38b-e487-4f35-a440-32258562fe86 tempest-GroupsV320Test-1413115282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5fe5d38b-e487-4f35-a440-32258562fe86 tempest-GroupsV320Test-1413115282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d38b-e487-4f35-a440-32258562fe86 tempest-GroupsV320Test-1413115282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d38b-e487-4f35-a440-32258562fe86 tempest-GroupsV320Test-1413115282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5fe5d38b-e487-4f35-a440-32258562fe86 tempest-GroupsV320Test-1413115282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5fe5d38b-e487-4f35-a440-32258562fe86 tempest-GroupsV320Test-1413115282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:49 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:19:49 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:49 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5fe5d38b-e487-4f35-a440-32258562fe86 tempest-GroupsV320Test-1413115282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.250s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:49 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-5fe5d38b-e487-4f35-a440-32258562fe86 tempest-GroupsV320Test-1413115282 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:19:49 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5fe5d38b-e487-4f35-a440-32258562fe86 tempest-GroupsV320Test-1413115282 None] Delete group completed successfully. Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Flow 'volume_create_manager' (3de642de-7516-4de0-a209-c23cfb9a7293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d9fae8-2de5-4e99-8415-4d5212cc979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d9fae8-2de5-4e99-8415-4d5212cc979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1903561696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d12f06-6de5-4095-a47a-55f9057b5f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045f6a0c076f4c3485b6cf76874440df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:52Z,use_quota=True,user_id='972b5a0a8e0144dc9e60137a75354a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd31bf56-c253-450b-8f1f-f301c1630a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd31bf56-c253-450b-8f1f-f301c1630a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34595a46-9afc-434e-b9c2-fb86b9359bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34595a46-9afc-434e-b9c2-fb86b9359bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d12f06-6de5-4095-a47a-55f9057b5f69', 'volume_name': 'volume-e3d12f06-6de5-4095-a47a-55f9057b5f69', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a194dc92-193e-4b00-bc9c-926afa78fd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a194dc92-193e-4b00-bc9c-926afa78fd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f80d43-5637-4f3f-b11d-9d54cbe5986d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:51 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Volume e3d12f06-6de5-4095-a47a-55f9057b5f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d12f06-6de5-4095-a47a-55f9057b5f69', 'volume_size': 1} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1903561696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d12f06-6de5-4095-a47a-55f9057b5f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045f6a0c076f4c3485b6cf76874440df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:19:52Z,use_quota=True,user_id='972b5a0a8e0144dc9e60137a75354a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Creating volume e3d12f06-6de5-4095-a47a-55f9057b5f69 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:19:51 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:19:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:51 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69 1073741824 Jul 23 03:19:51 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:52 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69 1073741824" returned: 0 in 0.540s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:52 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-b766ecc9-c14e-4c54-aa58-91640f6313da req-e327dcae-93e2-463d-9495-f04d47fc3373 tempest-TaggedAttachmentsTest-1284948248 None] Terminate volume connection completed successfully. Jul 23 03:19:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-b766ecc9-c14e-4c54-aa58-91640f6313da req-e327dcae-93e2-463d-9495-f04d47fc3373 tempest-TaggedAttachmentsTest-1284948248 None] Deleting attachment b1c45a55-2e28-4e00-9b59-0f4d15ff52e5. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:19:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:19:52 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69 Jul 23 03:19:52 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:19:52 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Jul 23 03:19:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69" returned: 0 in 0.295s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:19:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:19:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f80d43-5637-4f3f-b11d-9d54cbe5986d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d12f06-6de5-4095-a47a-55f9057b5f69', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4b06dc-f162-4326-831f-5549a114a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:19:52 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Volume volume-e3d12f06-6de5-4095-a47a-55f9057b5f69 (e3d12f06-6de5-4095-a47a-55f9057b5f69): created successfully Jul 23 03:19:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4b06dc-f162-4326-831f-5549a114a00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:19:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Flow 'volume_create_manager' (3de642de-7516-4de0-a209-c23cfb9a7293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:19:52 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f45a1093-9145-450b-b21f-d5809437fb68 tempest-AttachVolumeNegativeTest-985906857 None] Created volume successfully. Jul 23 03:19:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-a60a4c2f-1d4a-4cc4-9dcc-aec7260fb558 req-1f3cc1b4-a366-476d-bb08-3ea09812bcdb tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:19:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-a60a4c2f-1d4a-4cc4-9dcc-aec7260fb558 req-1f3cc1b4-a366-476d-bb08-3ea09812bcdb tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:19:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-a60a4c2f-1d4a-4cc4-9dcc-aec7260fb558 req-1f3cc1b4-a366-476d-bb08-3ea09812bcdb tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:19:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-a60a4c2f-1d4a-4cc4-9dcc-aec7260fb558 req-1f3cc1b4-a366-476d-bb08-3ea09812bcdb tempest-AttachVolumeNegativeTest-985906857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-e3d12f06-6de5-4095-a47a-55f9057b5f69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5c4caa0-91b9-4afe-bc30-388ce2e3993f', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:19:54 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-a60a4c2f-1d4a-4cc4-9dcc-aec7260fb558 req-1f3cc1b4-a366-476d-bb08-3ea09812bcdb tempest-AttachVolumeNegativeTest-985906857 None] attachment_update completed successfully. Jul 23 03:20:01 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-adc9ecf7-b8b5-467f-bb60-70016c4303d3 req-1283c7c9-9211-4a00-994f-d8be324a301b tempest-AttachVolumeTestJSON-211150349 None] Terminate volume connection completed successfully. Jul 23 03:20:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-adc9ecf7-b8b5-467f-bb60-70016c4303d3 req-1283c7c9-9211-4a00-994f-d8be324a301b tempest-AttachVolumeTestJSON-211150349 None] Deleting attachment 26918274-b624-46ca-9127-c2abdf5b54d4. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:20:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Acquiring lock "cinder-6af8f9a2-34e2-4cb8-9090-20f5e803d104-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Lock "cinder-6af8f9a2-34e2-4cb8-9090-20f5e803d104-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Acquiring lock "cinder-quobyte-6af8f9a2-34e2-4cb8-9090-20f5e803d104" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Lock "cinder-quobyte-6af8f9a2-34e2-4cb8-9090-20f5e803d104" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:02 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dc8aa9-a713-429b-843a-d90b2e46739f]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:03 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104 Jul 23 03:20:03 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:03 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104" returned: 0 in 0.592s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:03 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104 Jul 23 03:20:03 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:03 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6af8f9a2-34e2-4cb8-9090-20f5e803d104" returned: 0 in 0.488s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Lock "cinder-quobyte-6af8f9a2-34e2-4cb8-9090-20f5e803d104" released by "delete_volume" :: held 1.151s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:04 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Created reservations ['a63ca334-e18c-43ee-8280-3c3d6c3cf91c', 'c66714b5-a9ea-487b-8cb7-48636e6c56c8', 'dc498647-397e-4844-bb29-2abda53fd5e2', '76b65d04-6a1a-4577-8f7c-16eeb4b47494'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:04 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:20:04 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:04 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.299s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:04 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:04 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Deleted volume successfully. Jul 23 03:20:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-572dde30-4917-486d-bd7a-a27b4595c7a7 tempest-TaggedAttachmentsTest-1284948248 None] Lock "cinder-6af8f9a2-34e2-4cb8-9090-20f5e803d104-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:20:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:06 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:20:06 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:07 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.305s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Flow 'volume_create_manager' (2752f57b-b2f7-474e-8db3-fbd6b96fa187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b443a8-bf02-43b9-a6e0-ba464f84f4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b443a8-bf02-43b9-a6e0-ba464f84f4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1587141967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9faa4dfd-ee45-41ff-8f2b-a7738b0173b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fd07ac68e348e9955725caebf6480e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:12Z,use_quota=True,user_id='9da354d204d54ec59493af6a8b44d3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acf33cf7-8466-40fd-898f-cec2dbbf9b9b),volume_type_id=acf33cf7-8466-40fd-898f-cec2dbbf9b9b)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620e3aac-708f-4bfd-a991-9c554a1ff318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620e3aac-708f-4bfd-a991-9c554a1ff318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5427b89e-de08-489c-b6ea-fccc24bfb02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5427b89e-de08-489c-b6ea-fccc24bfb02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9faa4dfd-ee45-41ff-8f2b-a7738b0173b1', 'volume_name': 'volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcd4c17-9614-4d46-83e0-49c46b5631a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dcd4c17-9614-4d46-83e0-49c46b5631a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a99281-8a4f-4166-8084-545b2d0cf58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:12 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Volume 9faa4dfd-ee45-41ff-8f2b-a7738b0173b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1', 'volume_size': 1} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1587141967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9faa4dfd-ee45-41ff-8f2b-a7738b0173b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fd07ac68e348e9955725caebf6480e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:12Z,use_quota=True,user_id='9da354d204d54ec59493af6a8b44d3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(acf33cf7-8466-40fd-898f-cec2dbbf9b9b),volume_type_id=acf33cf7-8466-40fd-898f-cec2dbbf9b9b)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Creating volume 9faa4dfd-ee45-41ff-8f2b-a7738b0173b1 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:12 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:20:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:12 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1 1073741824 Jul 23 03:20:12 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:13 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1 1073741824" returned: 0 in 0.977s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:13 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1 Jul 23 03:20:13 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:13 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1" returned: 0 in 0.502s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a99281-8a4f-4166-8084-545b2d0cf58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e378f45-b6dd-4324-bb7c-9efd8910c631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:13 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Volume volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1 (9faa4dfd-ee45-41ff-8f2b-a7738b0173b1): created successfully Jul 23 03:20:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e378f45-b6dd-4324-bb7c-9efd8910c631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Flow 'volume_create_manager' (2752f57b-b2f7-474e-8db3-fbd6b96fa187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ab379deb-4cd7-45cb-a0a7-dc0559d5b3a4 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Created volume successfully. Jul 23 03:20:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-264f7e64-a66d-4389-b7d6-0c14c0e9ee77 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-264f7e64-a66d-4389-b7d6-0c14c0e9ee77 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-264f7e64-a66d-4389-b7d6-0c14c0e9ee77 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-264f7e64-a66d-4389-b7d6-0c14c0e9ee77 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-264f7e64-a66d-4389-b7d6-0c14c0e9ee77 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-264f7e64-a66d-4389-b7d6-0c14c0e9ee77 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:14 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:20:14 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:15 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-264f7e64-a66d-4389-b7d6-0c14c0e9ee77 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.363s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:15 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-264f7e64-a66d-4389-b7d6-0c14c0e9ee77 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-264f7e64-a66d-4389-b7d6-0c14c0e9ee77 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Retype volume completed successfully. Jul 23 03:20:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Acquiring lock "cinder-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "cinder-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Acquiring lock "cinder-quobyte-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "cinder-quobyte-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1" acquired by "delete_volume" :: waited 0.038s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:16 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[99adfb02-76c2-40c7-b9b4-7cf238114e78]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:16 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1 Jul 23 03:20:16 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:17 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1" returned: 0 in 0.794s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:17 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1 Jul 23 03:20:17 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:18 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1" returned: 0 in 0.652s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "cinder-quobyte-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1" released by "delete_volume" :: held 1.547s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:18 devstack cinder-volume[88392]: WARNING cinder.quota [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:20:18 devstack cinder-volume[88392]: WARNING cinder.quota [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Created reservations ['075b81cb-1d42-4c5d-8523-4c66f1d55415', '413f0862-0ccb-413c-b682-fbd0e47c3425', 'bef7be16-3564-4757-9cc0-12c9d9528e08', 'aac02235-932a-4349-9f26-883f34f7b919'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:18 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:20:18 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:18 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.369s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:18 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Deleted volume successfully. Jul 23 03:20:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-632be466-78ce-4139-8f72-0f6157427e36 tempest-VolumeRetypeWithoutMigrationTest-186728668 None] Lock "cinder-9faa4dfd-ee45-41ff-8f2b-a7738b0173b1-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:28 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=43,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:20:28 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=40,cinder:SELECT=43,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:20:31 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:20:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Flow 'volume_create_manager' (e4923710-c3a5-441a-9bb5-96744532661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7ec8d8-db61-4fd2-8e9d-64d5af7096c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7ec8d8-db61-4fd2-8e9d-64d5af7096c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1178539624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765023ad-9b1e-4c05-bbb7-ce549784712c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19b6b755d4b94c398a5337c32aa302fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:32Z,use_quota=True,user_id='2515c274523340d5849d8e582bb2bbff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc69fc43-31ce-4d2e-aa63-c80fe33463da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc69fc43-31ce-4d2e-aa63-c80fe33463da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f69943-2fa8-44ba-9717-d6ac80d4e5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f69943-2fa8-44ba-9717-d6ac80d4e5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765023ad-9b1e-4c05-bbb7-ce549784712c', 'volume_name': 'volume-765023ad-9b1e-4c05-bbb7-ce549784712c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad1c869-9315-44d5-8f51-1bbb97827fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad1c869-9315-44d5-8f51-1bbb97827fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b275e34e-0d6d-4b21-a4e5-930b5c2c027b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:32 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Volume 765023ad-9b1e-4c05-bbb7-ce549784712c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765023ad-9b1e-4c05-bbb7-ce549784712c', 'volume_size': 1} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1178539624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765023ad-9b1e-4c05-bbb7-ce549784712c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19b6b755d4b94c398a5337c32aa302fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:20:32Z,use_quota=True,user_id='2515c274523340d5849d8e582bb2bbff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Creating volume 765023ad-9b1e-4c05-bbb7-ce549784712c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:20:32 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:32 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c 1073741824 Jul 23 03:20:32 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:32 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c 1073741824" returned: 0 in 0.401s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:32 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c Jul 23 03:20:32 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:32 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c" returned: 0 in 0.322s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b275e34e-0d6d-4b21-a4e5-930b5c2c027b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765023ad-9b1e-4c05-bbb7-ce549784712c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65356c17-ed82-452f-bffb-753cd5a83b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:20:32 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Volume volume-765023ad-9b1e-4c05-bbb7-ce549784712c (765023ad-9b1e-4c05-bbb7-ce549784712c): created successfully Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65356c17-ed82-452f-bffb-753cd5a83b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:20:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Flow 'volume_create_manager' (e4923710-c3a5-441a-9bb5-96744532661c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:20:32 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e397d1e2-ce53-43e7-bbbf-1b77d9256ab8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Created volume successfully. Jul 23 03:20:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Creating offline snapshot 11d559fc-6dd2-4108-93d0-6078fb877c7d of volume 765023ad-9b1e-4c05-bbb7-ce549784712c {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:20:34 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7c6b1e-19cd-4577-a7ab-24662d291c7d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:34 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c Jul 23 03:20:34 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:34 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c" returned: 0 in 0.474s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:34 devstack sudo[92981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d 1G Jul 23 03:20:34 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:35 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d 1G" returned: 0 in 0.445s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765023ad-9b1e-4c05-bbb7-ce549784712c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:35 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765023ad-9b1e-4c05-bbb7-ce549784712c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d Jul 23 03:20:35 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:35 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-765023ad-9b1e-4c05-bbb7-ce549784712c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d" returned: 0 in 0.384s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:35 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d is being set with open permissions: ugo+rw Jul 23 03:20:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:35 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d Jul 23 03:20:35 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:36 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d" returned: 0 in 0.260s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:36 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.info Jul 23 03:20:36 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:36 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.info" returned: 0 in 0.262s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:36 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.info is being set with open permissions: ugo+rw Jul 23 03:20:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:36 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.info Jul 23 03:20:36 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:36 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.info" returned: 0 in 0.254s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-86d7672d-e8bb-4cbc-a0e9-60339d77d054 tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Create snapshot completed successfully Jul 23 03:20:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Acquiring lock "cinder-11d559fc-6dd2-4108-93d0-6078fb877c7d-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "cinder-11d559fc-6dd2-4108-93d0-6078fb877c7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Acquiring lock "cinder-quobyte-765023ad-9b1e-4c05-bbb7-ce549784712c" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "cinder-quobyte-765023ad-9b1e-4c05-bbb7-ce549784712c" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Acquiring lock "cinder-quobyte-11d559fc-6dd2-4108-93d0-6078fb877c7d" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "cinder-quobyte-11d559fc-6dd2-4108-93d0-6078fb877c7d" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Deleting offline snapshot 11d559fc-6dd2-4108-93d0-6078fb877c7d of volume 765023ad-9b1e-4c05-bbb7-ce549784712c {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:20:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] snapshot_file for this snap is: volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:20:38 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[515a8819-974b-4c1a-a6e4-28334d27db53]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:38 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d Jul 23 03:20:38 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:39 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d" returned: 0 in 0.702s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-765023ad-9b1e-4c05-bbb7-ce549784712c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:20:39 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d550232-7b47-46dd-87cd-059dee54201f]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:39 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c Jul 23 03:20:39 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:39 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c" returned: 0 in 0.667s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:39 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d Jul 23 03:20:39 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:40 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d" returned: 0 in 0.396s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:40 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d Jul 23 03:20:40 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:40 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c.11d559fc-6dd2-4108-93d0-6078fb877c7d" returned: 0 in 0.287s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "cinder-quobyte-11d559fc-6dd2-4108-93d0-6078fb877c7d" released by "_delete_snapshot" :: held 2.289s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "cinder-quobyte-765023ad-9b1e-4c05-bbb7-ce549784712c" released by "delete_snapshot" :: held 2.356s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:40 devstack cinder-volume[88392]: WARNING cinder.quota [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:20:40 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Created reservations ['42b20410-3485-4a6d-a7af-78f998d6c8d3', '55f8fc73-92cc-4e8d-8c94-49a795019adf', 'fe003d14-5ce9-4b23-a460-0c3b86e5e6c3', 'f23692ce-afe3-4d0c-a3ea-b120ddceb1d3'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:40 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Delete snapshot completed successfully. Jul 23 03:20:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f1c2213-f2a4-46a1-92de-4f4f768a665a tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "cinder-11d559fc-6dd2-4108-93d0-6078fb877c7d-delete_snapshot" released by "delete_snapshot" :: held 2.626s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Acquiring lock "cinder-765023ad-9b1e-4c05-bbb7-ce549784712c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "cinder-765023ad-9b1e-4c05-bbb7-ce549784712c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Acquiring lock "cinder-quobyte-765023ad-9b1e-4c05-bbb7-ce549784712c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:20:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "cinder-quobyte-765023ad-9b1e-4c05-bbb7-ce549784712c" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:20:41 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[160322ee-724a-4794-b0f0-b4808b066cf5]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:20:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:42 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c Jul 23 03:20:42 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:42 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c" returned: 0 in 0.466s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:42 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c Jul 23 03:20:42 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:42 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-765023ad-9b1e-4c05-bbb7-ce549784712c" returned: 0 in 0.326s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "cinder-quobyte-765023ad-9b1e-4c05-bbb7-ce549784712c" released by "delete_volume" :: held 0.880s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:42 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Created reservations ['d24bff45-1f37-4379-b16c-6ba9654fdb71', 'a31d4621-50cf-422d-a421-072cfa392751', 'f7a77ad5-e836-41f4-b639-5450c643237e', '9999bcc5-0486-4b9c-977a-da0d28d9e236'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:20:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:20:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:20:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:20:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:20:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:20:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:20:43 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:20:43 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:20:43 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Jul 23 03:20:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.379s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:20:43 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:20:43 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Deleted volume successfully. Jul 23 03:20:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5f959626-dc98-4299-a7fb-2f7debf60fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-1032887996 None] Lock "cinder-765023ad-9b1e-4c05-bbb7-ce549784712c-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:20:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-ff80238d-c3f7-4e14-97d1-cff62d4ec7e6 req-a60e0065-cd15-4d03-9ef2-c790fda2c819 tempest-AttachVolumeNegativeTest-985906857 None] Terminate volume connection completed successfully. Jul 23 03:20:47 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-ff80238d-c3f7-4e14-97d1-cff62d4ec7e6 req-a60e0065-cd15-4d03-9ef2-c790fda2c819 tempest-AttachVolumeNegativeTest-985906857 None] Deleting attachment e5c4caa0-91b9-4afe-bc30-388ce2e3993f. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:20:57 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=18,cinder:SELECT=16,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:20:57 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=18,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:21:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:21:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:06 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:21:06 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:07 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.499s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:21:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 8 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:21:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Flow 'volume_create_manager' (29570005-50e4-449a-8b26-93499324d3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffddf72f-1ce9-4cfd-b97d-42cfad7aa467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffddf72f-1ce9-4cfd-b97d-42cfad7aa467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1683575216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b03c3d-ce35-4b88-bfc7-1edbc551945e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b56be13f278344409101377aec829c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:19Z,use_quota=True,user_id='3029155314564c0ea802bb2952cb610d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b148aa-6f26-44c6-bf7c-42866af44de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b148aa-6f26-44c6-bf7c-42866af44de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e0818b-73d2-4431-99d1-b36aa458df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e0818b-73d2-4431-99d1-b36aa458df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b03c3d-ce35-4b88-bfc7-1edbc551945e', 'volume_name': 'volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32541278-2209-4bd1-81ba-d04ff984f7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32541278-2209-4bd1-81ba-d04ff984f7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1e658c-d29f-47a1-87d8-7a65ddb1a1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:18 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Volume d7b03c3d-ce35-4b88-bfc7-1edbc551945e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e', 'volume_size': 1} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1683575216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b03c3d-ce35-4b88-bfc7-1edbc551945e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b56be13f278344409101377aec829c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:19Z,use_quota=True,user_id='3029155314564c0ea802bb2952cb610d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Creating volume d7b03c3d-ce35-4b88-bfc7-1edbc551945e {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:18 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:21:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:18 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e 1073741824 Jul 23 03:21:18 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:19 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e 1073741824" returned: 0 in 0.615s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:19 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e Jul 23 03:21:19 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:19 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e" returned: 0 in 0.372s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1e658c-d29f-47a1-87d8-7a65ddb1a1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25db6a9-36b7-4029-96c8-478481185fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:19 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Volume volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e (d7b03c3d-ce35-4b88-bfc7-1edbc551945e): created successfully Jul 23 03:21:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25db6a9-36b7-4029-96c8-478481185fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Flow 'volume_create_manager' (29570005-50e4-449a-8b26-93499324d3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:19 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7667edc9-1ec6-4268-b00d-3fc775e73812 tempest-ServerActionsTestOtherA-1993422336 None] Created volume successfully. Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Flow 'volume_create_manager' (38f26ca5-b225-47cd-9729-008812d229a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb15440-c91c-4409-b4a6-6295a4094546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb15440-c91c-4409-b4a6-6295a4094546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-636903497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5fa74b-0ed4-4523-89e8-9363333ef087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525f087e6f2445c9ac16f6cbb0d03dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:23Z,use_quota=True,user_id='018dcfb89f264e67a075f5fd27a26a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf74830-7999-462d-ba14-84554a3952f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf74830-7999-462d-ba14-84554a3952f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dacd2cd2-b6e4-4cee-bcd9-12ad71fd1c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dacd2cd2-b6e4-4cee-bcd9-12ad71fd1c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5fa74b-0ed4-4523-89e8-9363333ef087', 'volume_name': 'volume-1c5fa74b-0ed4-4523-89e8-9363333ef087', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a74b2e-17b8-4b22-9148-048691890562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a74b2e-17b8-4b22-9148-048691890562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddc4932-3cd8-4ff2-a39a-9895e2bd3e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:23 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Volume 1c5fa74b-0ed4-4523-89e8-9363333ef087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5fa74b-0ed4-4523-89e8-9363333ef087', 'volume_size': 1} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-636903497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5fa74b-0ed4-4523-89e8-9363333ef087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525f087e6f2445c9ac16f6cbb0d03dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:23Z,use_quota=True,user_id='018dcfb89f264e67a075f5fd27a26a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Creating volume 1c5fa74b-0ed4-4523-89e8-9363333ef087 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:23 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:21:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:23 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087 1073741824 Jul 23 03:21:23 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:24 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087 1073741824" returned: 0 in 0.911s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:24 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087 Jul 23 03:21:24 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:24 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087" returned: 0 in 0.463s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddc4932-3cd8-4ff2-a39a-9895e2bd3e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5fa74b-0ed4-4523-89e8-9363333ef087', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67edcd34-1a94-4c2b-b8d0-dea28b84f752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:24 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Volume volume-1c5fa74b-0ed4-4523-89e8-9363333ef087 (1c5fa74b-0ed4-4523-89e8-9363333ef087): created successfully Jul 23 03:21:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67edcd34-1a94-4c2b-b8d0-dea28b84f752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Flow 'volume_create_manager' (38f26ca5-b225-47cd-9729-008812d229a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:24 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ded16231-3133-4cd9-97a2-6c1c991b0ce6 tempest-AttachVolumeTestJSON-211150349 None] Created volume successfully. Jul 23 03:21:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-13faaf26-a576-4d46-818f-60f3b90d4569 req-efdc655f-9d6a-47e0-b090-110cb9e49735 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-13faaf26-a576-4d46-818f-60f3b90d4569 req-efdc655f-9d6a-47e0-b090-110cb9e49735 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-13faaf26-a576-4d46-818f-60f3b90d4569 req-efdc655f-9d6a-47e0-b090-110cb9e49735 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-13faaf26-a576-4d46-818f-60f3b90d4569 req-efdc655f-9d6a-47e0-b090-110cb9e49735 tempest-AttachVolumeTestJSON-211150349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-1c5fa74b-0ed4-4523-89e8-9363333ef087', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '426d23df-434a-4817-a3cc-2eccc6c18c5a', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:21:26 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-13faaf26-a576-4d46-818f-60f3b90d4569 req-efdc655f-9d6a-47e0-b090-110cb9e49735 tempest-AttachVolumeTestJSON-211150349 None] attachment_update completed successfully. Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Flow 'volume_create_manager' (8bcfca63-9c0d-4b50-9ecc-54ba43c471f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44daa80a-3174-415b-93ca-445236bc9bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44daa80a-3174-415b-93ca-445236bc9bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1537512020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509798a2-758a-4e17-8115-1017a0b8bd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525f087e6f2445c9ac16f6cbb0d03dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:29Z,use_quota=True,user_id='018dcfb89f264e67a075f5fd27a26a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fe39f6-5f96-45ee-90f9-c34d583f673d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61fe39f6-5f96-45ee-90f9-c34d583f673d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3bce69-a99e-47b2-8049-be76908e935b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3bce69-a99e-47b2-8049-be76908e935b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509798a2-758a-4e17-8115-1017a0b8bd55', 'volume_name': 'volume-509798a2-758a-4e17-8115-1017a0b8bd55', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938b761b-ce94-44ef-b764-9efc1720e311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938b761b-ce94-44ef-b764-9efc1720e311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6636cc-0fb8-4f1d-87c4-25ff522a6a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:29 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Volume 509798a2-758a-4e17-8115-1017a0b8bd55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509798a2-758a-4e17-8115-1017a0b8bd55', 'volume_size': 1} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1537512020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509798a2-758a-4e17-8115-1017a0b8bd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525f087e6f2445c9ac16f6cbb0d03dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:29Z,use_quota=True,user_id='018dcfb89f264e67a075f5fd27a26a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Creating volume 509798a2-758a-4e17-8115-1017a0b8bd55 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:29 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:21:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:29 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55 1073741824 Jul 23 03:21:29 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:30 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55 1073741824" returned: 0 in 0.710s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:30 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55 Jul 23 03:21:30 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:30 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55" returned: 0 in 0.279s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6636cc-0fb8-4f1d-87c4-25ff522a6a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509798a2-758a-4e17-8115-1017a0b8bd55', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53085db-b520-4aa2-88a3-f5c93f102ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:30 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Volume volume-509798a2-758a-4e17-8115-1017a0b8bd55 (509798a2-758a-4e17-8115-1017a0b8bd55): created successfully Jul 23 03:21:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53085db-b520-4aa2-88a3-f5c93f102ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Flow 'volume_create_manager' (8bcfca63-9c0d-4b50-9ecc-54ba43c471f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-fcbfcf1c-0192-44f0-a757-3b254ea43db9 tempest-AttachVolumeTestJSON-211150349 None] Created volume successfully. Jul 23 03:21:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-9693ce25-2971-44ce-bc9b-43edce6476bb req-494ece60-6788-4d58-8fcb-90720471407b tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-9693ce25-2971-44ce-bc9b-43edce6476bb req-494ece60-6788-4d58-8fcb-90720471407b tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-9693ce25-2971-44ce-bc9b-43edce6476bb req-494ece60-6788-4d58-8fcb-90720471407b tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-9693ce25-2971-44ce-bc9b-43edce6476bb req-494ece60-6788-4d58-8fcb-90720471407b tempest-AttachVolumeTestJSON-211150349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-509798a2-758a-4e17-8115-1017a0b8bd55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9665ead-2431-4501-a17a-b4a6aca914df', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:21:33 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-9693ce25-2971-44ce-bc9b-43edce6476bb req-494ece60-6788-4d58-8fcb-90720471407b tempest-AttachVolumeTestJSON-211150349 None] attachment_update completed successfully. Jul 23 03:21:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-983896fd-7e64-477c-ac8c-003b86e071bb req-3aba8863-d3ae-4c20-ab58-ab2be58b95a5 tempest-AttachVolumeTestJSON-211150349 None] Terminate volume connection completed successfully. Jul 23 03:21:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-983896fd-7e64-477c-ac8c-003b86e071bb req-3aba8863-d3ae-4c20-ab58-ab2be58b95a5 tempest-AttachVolumeTestJSON-211150349 None] Deleting attachment 426d23df-434a-4817-a3cc-2eccc6c18c5a. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Flow 'volume_create_manager' (f37c69c0-3329-4ce1-bb66-8db03f001cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bcc0727-d4a6-4e0b-97aa-0ebb57868cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bcc0727-d4a6-4e0b-97aa-0ebb57868cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1999266459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50937964-8849-4574-bbd3-10816f317e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045f6a0c076f4c3485b6cf76874440df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:38Z,use_quota=True,user_id='972b5a0a8e0144dc9e60137a75354a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06628d29-2b94-433a-81e4-38ec9ed02db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06628d29-2b94-433a-81e4-38ec9ed02db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6db5e8d-3292-4e6f-8307-a202b4d0fe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6db5e8d-3292-4e6f-8307-a202b4d0fe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50937964-8849-4574-bbd3-10816f317e25', 'volume_name': 'volume-50937964-8849-4574-bbd3-10816f317e25', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f86b8-3056-45e8-9b8f-4bf7d40fa8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f86b8-3056-45e8-9b8f-4bf7d40fa8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31087f2-ff73-432c-afb8-eeef28ebe6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:38 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Volume 50937964-8849-4574-bbd3-10816f317e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50937964-8849-4574-bbd3-10816f317e25', 'volume_size': 1} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1999266459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50937964-8849-4574-bbd3-10816f317e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045f6a0c076f4c3485b6cf76874440df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:38Z,use_quota=True,user_id='972b5a0a8e0144dc9e60137a75354a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Creating volume 50937964-8849-4574-bbd3-10816f317e25 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:38 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:38 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25 1073741824 Jul 23 03:21:38 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:38 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-ccc99368-ecfb-488e-ba46-9d9f059140f6 req-87edd367-40b1-49cf-a175-dd97f483e3a4 tempest-AttachVolumeTestJSON-211150349 None] Terminate volume connection completed successfully. Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-ccc99368-ecfb-488e-ba46-9d9f059140f6 req-87edd367-40b1-49cf-a175-dd97f483e3a4 tempest-AttachVolumeTestJSON-211150349 None] Deleting attachment f9665ead-2431-4501-a17a-b4a6aca914df. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:21:38 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25 1073741824" returned: 0 in 0.559s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:38 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25 Jul 23 03:21:38 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:39 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25" returned: 0 in 0.332s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31087f2-ff73-432c-afb8-eeef28ebe6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50937964-8849-4574-bbd3-10816f317e25', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c707b496-de41-4c23-ac21-722b8923586e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Volume volume-50937964-8849-4574-bbd3-10816f317e25 (50937964-8849-4574-bbd3-10816f317e25): created successfully Jul 23 03:21:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c707b496-de41-4c23-ac21-722b8923586e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Flow 'volume_create_manager' (f37c69c0-3329-4ce1-bb66-8db03f001cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b21ab5b9-9838-419e-a987-62a83109da8e tempest-AttachVolumeNegativeTest-985906857 None] Created volume successfully. Jul 23 03:21:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-80dd9b62-8a74-4c5d-b1ca-463dabd1cdc9 req-23d3d544-c41c-4488-b86a-11fa4e6a0be7 tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-80dd9b62-8a74-4c5d-b1ca-463dabd1cdc9 req-23d3d544-c41c-4488-b86a-11fa4e6a0be7 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-80dd9b62-8a74-4c5d-b1ca-463dabd1cdc9 req-23d3d544-c41c-4488-b86a-11fa4e6a0be7 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-80dd9b62-8a74-4c5d-b1ca-463dabd1cdc9 req-23d3d544-c41c-4488-b86a-11fa4e6a0be7 tempest-AttachVolumeNegativeTest-985906857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-50937964-8849-4574-bbd3-10816f317e25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c11abb4e-ec05-4c59-b7c4-47248753a4b6', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:21:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-80dd9b62-8a74-4c5d-b1ca-463dabd1cdc9 req-23d3d544-c41c-4488-b86a-11fa4e6a0be7 tempest-AttachVolumeNegativeTest-985906857 None] attachment_update completed successfully. Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (d41497eb-7564-4576-934e-9fd690bee239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ec71c0-15cd-4576-9552-5d93a7ba7d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ec71c0-15cd-4576-9552-5d93a7ba7d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1970866207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452a65c1-9d45-4345-8d13-cb0c0540a12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:43Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4565c748-3ed6-4f49-9a5d-d154092ef160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4565c748-3ed6-4f49-9a5d-d154092ef160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319bcf06-6560-497c-b112-cab3f94d123f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319bcf06-6560-497c-b112-cab3f94d123f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '452a65c1-9d45-4345-8d13-cb0c0540a12d', 'volume_name': 'volume-452a65c1-9d45-4345-8d13-cb0c0540a12d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1288922d-d350-43d3-8347-fb15953dc9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1288922d-d350-43d3-8347-fb15953dc9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd9722a-e672-4d83-9be2-565e905619f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:43 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Volume 452a65c1-9d45-4345-8d13-cb0c0540a12d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-452a65c1-9d45-4345-8d13-cb0c0540a12d', 'volume_size': 1} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1970866207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452a65c1-9d45-4345-8d13-cb0c0540a12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:43Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Creating volume 452a65c1-9d45-4345-8d13-cb0c0540a12d {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:43 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:21:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:43 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d 1073741824 Jul 23 03:21:43 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:44 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d 1073741824" returned: 0 in 0.960s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:44 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d Jul 23 03:21:44 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:44 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d" returned: 0 in 0.286s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd9722a-e672-4d83-9be2-565e905619f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452a65c1-9d45-4345-8d13-cb0c0540a12d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79311e88-c4bf-4605-a320-58b3643e748a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:44 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Volume volume-452a65c1-9d45-4345-8d13-cb0c0540a12d (452a65c1-9d45-4345-8d13-cb0c0540a12d): created successfully Jul 23 03:21:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79311e88-c4bf-4605-a320-58b3643e748a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (d41497eb-7564-4576-934e-9fd690bee239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b393a931-c175-4207-9819-2fb1fba7123e tempest-VolumesActionsTest-771004676 None] Created volume successfully. Jul 23 03:21:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a6f376d9-81cd-426d-9524-acc1be0d3165 tempest-VolumesActionsTest-771004676 None] Acquiring lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d" by "attach_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a6f376d9-81cd-426d-9524-acc1be0d3165 tempest-VolumesActionsTest-771004676 None] Lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d" acquired by "attach_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a6f376d9-81cd-426d-9524-acc1be0d3165 tempest-VolumesActionsTest-771004676 None] Attaching volume 452a65c1-9d45-4345-8d13-cb0c0540a12d to instance d0184800-a464-4272-b943-99626249e02d at mountpoint /dev/vdb on host None. Jul 23 03:21:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a6f376d9-81cd-426d-9524-acc1be0d3165 tempest-VolumesActionsTest-771004676 None] Attach volume completed successfully. Jul 23 03:21:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a6f376d9-81cd-426d-9524-acc1be0d3165 tempest-VolumesActionsTest-771004676 None] Lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d" released by "attach_volume" :: held 0.135s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-98140c76-f720-4e08-add8-0b2926d63d6f tempest-VolumesActionsTest-1957843986 None] Terminate volume connection completed successfully. Jul 23 03:21:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-98140c76-f720-4e08-add8-0b2926d63d6f tempest-VolumesActionsTest-1957843986 None] Acquiring lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d-detach_volume" by "detach_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-98140c76-f720-4e08-add8-0b2926d63d6f tempest-VolumesActionsTest-1957843986 None] Lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-98140c76-f720-4e08-add8-0b2926d63d6f tempest-VolumesActionsTest-1957843986 None] Detaching volume 452a65c1-9d45-4345-8d13-cb0c0540a12d from instance d0184800-a464-4272-b943-99626249e02d. Jul 23 03:21:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-98140c76-f720-4e08-add8-0b2926d63d6f tempest-VolumesActionsTest-1957843986 None] Detach volume completed successfully. Jul 23 03:21:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-98140c76-f720-4e08-add8-0b2926d63d6f tempest-VolumesActionsTest-1957843986 None] Lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-fc12ef57-e174-41ee-89de-afc8b4c7a39c tempest-VolumesActionsTest-771004676 None] Acquiring lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d-detach_volume" by "detach_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-fc12ef57-e174-41ee-89de-afc8b4c7a39c tempest-VolumesActionsTest-771004676 None] Lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-fc12ef57-e174-41ee-89de-afc8b4c7a39c tempest-VolumesActionsTest-771004676 None] Volume detach called, but volume not attached. Jul 23 03:21:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-de83028a-329f-43f4-9652-b73eb1e99c9d req-144cca5c-c22a-4368-9949-6c1106ece6c0 tempest-AttachVolumeNegativeTest-985906857 None] Terminate volume connection completed successfully. Jul 23 03:21:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-de83028a-329f-43f4-9652-b73eb1e99c9d req-144cca5c-c22a-4368-9949-6c1106ece6c0 tempest-AttachVolumeNegativeTest-985906857 None] Deleting attachment c11abb4e-ec05-4c59-b7c4-47248753a4b6. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:21:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-fc12ef57-e174-41ee-89de-afc8b4c7a39c tempest-VolumesActionsTest-771004676 None] Lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Acquiring lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Acquiring lock "cinder-quobyte-452a65c1-9d45-4345-8d13-cb0c0540a12d" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Lock "cinder-quobyte-452a65c1-9d45-4345-8d13-cb0c0540a12d" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5369bc-3eb5-4cb7-bc56-5eaf9fbe458d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:47 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d Jul 23 03:21:47 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "cinder-509798a2-758a-4e17-8115-1017a0b8bd55-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-509798a2-758a-4e17-8115-1017a0b8bd55-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "cinder-quobyte-509798a2-758a-4e17-8115-1017a0b8bd55" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-quobyte-509798a2-758a-4e17-8115-1017a0b8bd55" acquired by "delete_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a962e3e3-823f-4be7-bc68-f274b6c7ed32]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:47 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d" returned: 0 in 0.426s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:47 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55 Jul 23 03:21:47 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:47 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d Jul 23 03:21:47 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:47 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-452a65c1-9d45-4345-8d13-cb0c0540a12d" returned: 0 in 0.245s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Lock "cinder-quobyte-452a65c1-9d45-4345-8d13-cb0c0540a12d" released by "delete_volume" :: held 0.720s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:47 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55" returned: 0 in 0.376s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:47 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55 Jul 23 03:21:47 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Created reservations ['462bfc92-e98c-4176-b6b5-f7df963c2d40', '2511561e-097d-4009-a676-f0499e351a12', '4f790a1f-8f15-4f27-aa3c-2a1fba70c7c2', 'e9f52e79-741e-4f29-a1f4-de817c296695'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:48 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:21:48 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:48 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-509798a2-758a-4e17-8115-1017a0b8bd55" returned: 0 in 0.284s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-quobyte-509798a2-758a-4e17-8115-1017a0b8bd55" released by "delete_volume" :: held 0.714s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Created reservations ['2dec5fd0-a95c-4d43-9d32-c2358c703f9f', 'c5106e0f-5d1e-44c3-b37b-c45d1abcded1', '70d872ea-0df4-4638-b972-31881326a46e', '426258d1-24e5-4608-b8b3-97b71daa5ba5'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:48 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:21:48 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:48 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.539s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:48 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Deleted volume successfully. Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-880046a0-2fa3-4d6b-9d27-1697dc13fb27 tempest-VolumesActionsTest-771004676 None] Lock "cinder-452a65c1-9d45-4345-8d13-cb0c0540a12d-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "cinder-1c5fa74b-0ed4-4523-89e8-9363333ef087-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-1c5fa74b-0ed4-4523-89e8-9363333ef087-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "cinder-quobyte-1c5fa74b-0ed4-4523-89e8-9363333ef087" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-quobyte-1c5fa74b-0ed4-4523-89e8-9363333ef087" acquired by "delete_volume" :: waited 0.031s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99f4ce2-8a59-4060-9e52-9cd777f1dd46]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:49 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087 Jul 23 03:21:49 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:49 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.759s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:49 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:49 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Deleted volume successfully. Jul 23 03:21:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e42f6d08-75d7-4982-a53f-f912b63745eb tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-509798a2-758a-4e17-8115-1017a0b8bd55-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:49 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087" returned: 0 in 0.702s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:49 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087 Jul 23 03:21:49 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:49 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1c5fa74b-0ed4-4523-89e8-9363333ef087" returned: 0 in 0.317s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-quobyte-1c5fa74b-0ed4-4523-89e8-9363333ef087" released by "delete_volume" :: held 1.097s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:49 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Created reservations ['20b0eadf-1fe1-4a96-bed4-163689c348e9', 'bbf53a9f-2467-4951-a902-dc0ac02e31af', '18b89178-7590-41e5-9a6b-6f873caa06b5', '8ae605e6-0235-4dba-b49c-9c1834de6cba'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:50 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:21:50 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:50 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.299s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:50 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:50 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Deleted volume successfully. Jul 23 03:21:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-25a114a0-4270-4e26-a628-240363211644 tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-1c5fa74b-0ed4-4523-89e8-9363333ef087-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "cinder-90004529-a948-4e49-8e14-b6176271678c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-90004529-a948-4e49-8e14-b6176271678c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "cinder-quobyte-90004529-a948-4e49-8e14-b6176271678c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-quobyte-90004529-a948-4e49-8e14-b6176271678c" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:51 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[24875281-909c-4cce-a289-b577ee28882d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:51 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c Jul 23 03:21:51 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:51 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c" returned: 0 in 0.405s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:51 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c Jul 23 03:21:51 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:52 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-90004529-a948-4e49-8e14-b6176271678c" returned: 0 in 0.432s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-quobyte-90004529-a948-4e49-8e14-b6176271678c" released by "delete_volume" :: held 0.883s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Created reservations ['4a12b9ef-7b9d-4168-b49f-a77738143f57', '66c0c22c-bb15-4b2f-a4fa-4274b6c8546d', 'e4cf34f6-fdfe-4eed-8d1d-88e7ddf78cd5', 'd9bb0801-efb8-4078-92e8-4b8e3cac686b'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:52 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:21:52 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:52 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.305s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:52 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Deleted volume successfully. Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d700f7e-9318-45d4-9c7b-143882de3918 tempest-AttachVolumeTestJSON-211150349 None] Lock "cinder-90004529-a948-4e49-8e14-b6176271678c-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (4c5e97e0-8bef-4ee6-be18-0eb265e68abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96522d3e-a16a-4ce2-a3c3-9ea5f1c10811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96522d3e-a16a-4ce2-a3c3-9ea5f1c10811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1643404146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabee2a0-b791-4f9d-92d6-ce36fda40546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:53Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0dd2f3-311c-4b3b-9a18-3afba9f3d5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0dd2f3-311c-4b3b-9a18-3afba9f3d5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b29a88b-dbdb-431f-8229-e386935bedd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b29a88b-dbdb-431f-8229-e386935bedd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aabee2a0-b791-4f9d-92d6-ce36fda40546', 'volume_name': 'volume-aabee2a0-b791-4f9d-92d6-ce36fda40546', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94857841-7c73-4cd3-9369-546016eb85ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94857841-7c73-4cd3-9369-546016eb85ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec922d83-00ba-4b29-9309-5179e3e1559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:52 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Volume aabee2a0-b791-4f9d-92d6-ce36fda40546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aabee2a0-b791-4f9d-92d6-ce36fda40546', 'volume_size': 1} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1643404146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabee2a0-b791-4f9d-92d6-ce36fda40546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:53Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Creating volume aabee2a0-b791-4f9d-92d6-ce36fda40546 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:52 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:21:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:52 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546 1073741824 Jul 23 03:21:52 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:53 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546 1073741824" returned: 0 in 0.499s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:53 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546 Jul 23 03:21:53 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:53 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546" returned: 0 in 0.366s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec922d83-00ba-4b29-9309-5179e3e1559c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabee2a0-b791-4f9d-92d6-ce36fda40546', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e99e9b0-f81b-4593-8ec1-c235bbfe4cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:53 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Volume volume-aabee2a0-b791-4f9d-92d6-ce36fda40546 (aabee2a0-b791-4f9d-92d6-ce36fda40546): created successfully Jul 23 03:21:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e99e9b0-f81b-4593-8ec1-c235bbfe4cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (4c5e97e0-8bef-4ee6-be18-0eb265e68abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:53 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-adc1b928-32e0-4b83-982f-b0677ae1acd4 tempest-VolumesActionsTest-771004676 None] Created volume successfully. Jul 23 03:21:54 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Acquiring lock "cinder-aabee2a0-b791-4f9d-92d6-ce36fda40546-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:54 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-aabee2a0-b791-4f9d-92d6-ce36fda40546-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Acquiring lock "cinder-quobyte-aabee2a0-b791-4f9d-92d6-ce36fda40546" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-quobyte-aabee2a0-b791-4f9d-92d6-ce36fda40546" acquired by "delete_volume" :: waited 0.013s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:55 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b620f8-99cb-4c7e-a999-e0f191f380a5]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:55 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546 Jul 23 03:21:55 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:55 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546" returned: 0 in 0.428s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:55 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546 Jul 23 03:21:55 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:55 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-aabee2a0-b791-4f9d-92d6-ce36fda40546" returned: 0 in 0.369s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-quobyte-aabee2a0-b791-4f9d-92d6-ce36fda40546" released by "delete_volume" :: held 0.856s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:55 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Created reservations ['04fc8e55-cdd2-4fad-8d8f-6db907e74310', '794c9dd3-c8e6-4b6d-85ca-9706dc5acbdf', '56ef1565-2877-4831-99ef-2dd908e44764', 'd8e59130-d53a-413c-8662-9e087a81001d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:21:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:56 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:21:56 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:56 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.368s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:56 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:21:56 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Deleted volume successfully. Jul 23 03:21:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-00ba30fc-cb88-41c4-bf88-c2068222e5d9 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-aabee2a0-b791-4f9d-92d6-ce36fda40546-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (f1d6fb2e-f213-402d-9bcd-6992c1e9b513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdf6b80-be05-4c52-a440-3505eb009eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdf6b80-be05-4c52-a440-3505eb009eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-641580173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e6492e-4017-4d48-aa22-74f8eb953e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:57Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e06ed9-c08e-4569-bbff-35157af9f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e06ed9-c08e-4569-bbff-35157af9f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee07d90-a41b-44e5-a369-935e7671b1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee07d90-a41b-44e5-a369-935e7671b1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e6492e-4017-4d48-aa22-74f8eb953e18', 'volume_name': 'volume-d0e6492e-4017-4d48-aa22-74f8eb953e18', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfe6c26-772b-4e10-a885-884b3a95621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfe6c26-772b-4e10-a885-884b3a95621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba67d0f-5199-48b4-ac81-803922002f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:57 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Volume d0e6492e-4017-4d48-aa22-74f8eb953e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e6492e-4017-4d48-aa22-74f8eb953e18', 'volume_size': 1} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-641580173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e6492e-4017-4d48-aa22-74f8eb953e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:21:57Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Creating volume d0e6492e-4017-4d48-aa22-74f8eb953e18 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:21:57 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:57 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18 1073741824 Jul 23 03:21:57 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-cdaf28ad-5dcd-4837-9835-099cf9f568cb req-54a1ced6-7c3e-4546-9f3c-6b70bdcfb1a1 tempest-ServerActionsTestOtherA-1993422336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:21:57 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18 1073741824" returned: 0 in 0.453s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:57 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18 Jul 23 03:21:57 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:21:57 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18" returned: 0 in 0.287s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-cdaf28ad-5dcd-4837-9835-099cf9f568cb req-54a1ced6-7c3e-4546-9f3c-6b70bdcfb1a1 tempest-ServerActionsTestOtherA-1993422336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.746s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba67d0f-5199-48b4-ac81-803922002f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e6492e-4017-4d48-aa22-74f8eb953e18', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d602fe04-a70a-4cf9-8644-7ccc7f5363c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:21:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-cdaf28ad-5dcd-4837-9835-099cf9f568cb req-54a1ced6-7c3e-4546-9f3c-6b70bdcfb1a1 tempest-ServerActionsTestOtherA-1993422336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:21:58 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Volume volume-d0e6492e-4017-4d48-aa22-74f8eb953e18 (d0e6492e-4017-4d48-aa22-74f8eb953e18): created successfully Jul 23 03:21:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d602fe04-a70a-4cf9-8644-7ccc7f5363c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:21:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (f1d6fb2e-f213-402d-9bcd-6992c1e9b513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:21:58 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a5546287-d8e3-45cc-8319-f4fd0c3a52af tempest-VolumesActionsTest-771004676 None] Created volume successfully. Jul 23 03:21:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-cdaf28ad-5dcd-4837-9835-099cf9f568cb req-54a1ced6-7c3e-4546-9f3c-6b70bdcfb1a1 tempest-ServerActionsTestOtherA-1993422336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc17bd40-2cd5-4736-aed6-f4f69a1b4149', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:21:58 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-cdaf28ad-5dcd-4837-9835-099cf9f568cb req-54a1ced6-7c3e-4546-9f3c-6b70bdcfb1a1 tempest-ServerActionsTestOtherA-1993422336 None] attachment_update completed successfully. Jul 23 03:21:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Acquiring lock "cinder-d0e6492e-4017-4d48-aa22-74f8eb953e18-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-d0e6492e-4017-4d48-aa22-74f8eb953e18-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Acquiring lock "cinder-quobyte-d0e6492e-4017-4d48-aa22-74f8eb953e18" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:21:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-quobyte-d0e6492e-4017-4d48-aa22-74f8eb953e18" acquired by "delete_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:21:59 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fd6073-b0da-4c6f-a19f-57114a83c679]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:21:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:21:59 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18 Jul 23 03:21:59 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:00 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18" returned: 0 in 0.479s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:00 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18 Jul 23 03:22:00 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:00 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d0e6492e-4017-4d48-aa22-74f8eb953e18" returned: 0 in 0.319s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:00 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-quobyte-d0e6492e-4017-4d48-aa22-74f8eb953e18" released by "delete_volume" :: held 0.849s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:00 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Created reservations ['0c3c84f4-21b5-4dcc-951c-1d858d28df1d', 'e68a55f4-8987-45b9-87fc-a015e4e8ada6', 'dd5f582e-c514-4355-857c-e2b3fe15c277', '69eb4425-af86-48a5-8deb-a0279e2514bc'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:00 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:00 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:00 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:00 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:01 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.469s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:01 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:01 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Deleted volume successfully. Jul 23 03:22:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-967801ab-ee96-40c8-81bd-b69ed3fe2477 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-d0e6492e-4017-4d48-aa22-74f8eb953e18-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Flow 'volume_create_manager' (d501aa08-bbc2-43dc-9498-e19e065fb939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f14583-012d-4bf5-932a-cd34d4789d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (ab5835a0-464b-4b63-975d-81463ac101a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564d9bfc-6cf5-4354-848c-3780672aa0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f14583-012d-4bf5-932a-cd34d4789d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1376235001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85014190-8ae5-42a6-8d97-eb769c054f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bed55f284162491f854a7bb570a6c7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:02Z,use_quota=True,user_id='3c65871c24424c219d1d18c44b50003a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8b1aeb-39b7-4c68-a6ef-326ebdd2e759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8b1aeb-39b7-4c68-a6ef-326ebdd2e759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b977a9c4-7e71-4cf3-a716-dce1907edd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b977a9c4-7e71-4cf3-a716-dce1907edd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85014190-8ae5-42a6-8d97-eb769c054f3c', 'volume_name': 'volume-85014190-8ae5-42a6-8d97-eb769c054f3c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491401d0-bede-4181-b896-7e4cf56472af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491401d0-bede-4181-b896-7e4cf56472af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b547280-d867-4bd3-8060-3da713412100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Volume 85014190-8ae5-42a6-8d97-eb769c054f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85014190-8ae5-42a6-8d97-eb769c054f3c', 'volume_size': 1} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1376235001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85014190-8ae5-42a6-8d97-eb769c054f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bed55f284162491f854a7bb570a6c7ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:02Z,use_quota=True,user_id='3c65871c24424c219d1d18c44b50003a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Creating volume 85014190-8ae5-42a6-8d97-eb769c054f3c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:02 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:02 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c 1073741824 Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (564d9bfc-6cf5-4354-848c-3780672aa0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1136574240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7de2e6-b388-41e0-af8e-998c636fe6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:02Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1647955-63c1-4b33-a80a-858d729e7cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1647955-63c1-4b33-a80a-858d729e7cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576848eb-ca8e-446b-b9b2-dac0a0730760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576848eb-ca8e-446b-b9b2-dac0a0730760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c7de2e6-b388-41e0-af8e-998c636fe6e7', 'volume_name': 'volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cc45ae-02bf-41ee-9f80-acbfdf376a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67cc45ae-02bf-41ee-9f80-acbfdf376a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76891e07-4d99-4683-a2c6-ecb2c0400717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:02 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Volume 3c7de2e6-b388-41e0-af8e-998c636fe6e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7', 'volume_size': 1} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:02 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c 1073741824" returned: 0 in 0.521s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:02 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c Jul 23 03:22:02 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:03 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-d2d2ced8-5805-4601-9297-9fd604281183 req-8590f8b0-c1e9-44fc-9e20-fe485a64394e tempest-ServerActionsTestOtherA-1993422336 None] Terminate volume connection completed successfully. Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-d2d2ced8-5805-4601-9297-9fd604281183 req-8590f8b0-c1e9-44fc-9e20-fe485a64394e tempest-ServerActionsTestOtherA-1993422336 None] Deleting attachment cc17bd40-2cd5-4736-aed6-f4f69a1b4149. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:22:03 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c" returned: 0 in 0.377s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1136574240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7de2e6-b388-41e0-af8e-998c636fe6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:02Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Creating volume 3c7de2e6-b388-41e0-af8e-998c636fe6e7 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:03 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b547280-d867-4bd3-8060-3da713412100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85014190-8ae5-42a6-8d97-eb769c054f3c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869b24e2-a926-4f51-96ac-e693fe986a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:03 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7 1073741824 Jul 23 03:22:03 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:03 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Volume volume-85014190-8ae5-42a6-8d97-eb769c054f3c (85014190-8ae5-42a6-8d97-eb769c054f3c): created successfully Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869b24e2-a926-4f51-96ac-e693fe986a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Flow 'volume_create_manager' (d501aa08-bbc2-43dc-9498-e19e065fb939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:03 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-af0134e9-4bf3-4114-98da-4b348f524c43 req-a994df19-64c5-46fa-bfa7-659bd6d40dc0 tempest-VolumesSnapshotsTestJSON-270683931 None] Created volume successfully. Jul 23 03:22:04 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7 1073741824" returned: 0 in 0.791s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:04 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7 Jul 23 03:22:04 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-d2d2ced8-5805-4601-9297-9fd604281183 req-fc7f8573-2d7e-46ec-96b6-5c86c9beede7 tempest-ServerActionsTestOtherA-1993422336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:04 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7" returned: 0 in 0.294s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-d2d2ced8-5805-4601-9297-9fd604281183 req-fc7f8573-2d7e-46ec-96b6-5c86c9beede7 tempest-ServerActionsTestOtherA-1993422336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.236s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76891e07-4d99-4683-a2c6-ecb2c0400717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d143898d-9140-4008-aa44-a4be9b4544ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-d2d2ced8-5805-4601-9297-9fd604281183 req-fc7f8573-2d7e-46ec-96b6-5c86c9beede7 tempest-ServerActionsTestOtherA-1993422336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.059s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:04 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Volume volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7 (3c7de2e6-b388-41e0-af8e-998c636fe6e7): created successfully Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d143898d-9140-4008-aa44-a4be9b4544ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (ab5835a0-464b-4b63-975d-81463ac101a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:04 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a1a2afc3-3fc1-4919-a922-4999da04e4de tempest-VolumesActionsTest-771004676 None] Created volume successfully. Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-d2d2ced8-5805-4601-9297-9fd604281183 req-fc7f8573-2d7e-46ec-96b6-5c86c9beede7 tempest-ServerActionsTestOtherA-1993422336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abcba1ec-7f2b-4d3a-852c-47c9fcf70976', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:22:04 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-d2d2ced8-5805-4601-9297-9fd604281183 req-fc7f8573-2d7e-46ec-96b6-5c86c9beede7 tempest-ServerActionsTestOtherA-1993422336 None] attachment_update completed successfully. Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] Creating offline snapshot 30eafd4d-fd36-4ad5-8f38-2627826aaab0 of volume 85014190-8ae5-42a6-8d97-eb769c054f3c {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:22:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f1f21d-5678-4485-a087-b1f885e1120e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:05 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c Jul 23 03:22:05 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Acquiring lock "cinder-3c7de2e6-b388-41e0-af8e-998c636fe6e7-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-3c7de2e6-b388-41e0-af8e-998c636fe6e7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Acquiring lock "cinder-quobyte-3c7de2e6-b388-41e0-af8e-998c636fe6e7" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-quobyte-3c7de2e6-b388-41e0-af8e-998c636fe6e7" acquired by "delete_volume" :: waited 0.047s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[048c8c03-f829-41a0-913f-022bdf0eaa3d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:05 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c" returned: 0 in 0.707s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:05 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 1G Jul 23 03:22:05 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:05 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7 Jul 23 03:22:05 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:06 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7" returned: 0 in 0.643s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:06 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7 Jul 23 03:22:06 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:06 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 1G" returned: 0 in 0.641s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85014190-8ae5-42a6-8d97-eb769c054f3c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:06 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85014190-8ae5-42a6-8d97-eb769c054f3c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 Jul 23 03:22:06 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:06 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3c7de2e6-b388-41e0-af8e-998c636fe6e7" returned: 0 in 0.418s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-quobyte-3c7de2e6-b388-41e0-af8e-998c636fe6e7" released by "delete_volume" :: held 1.145s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Created reservations ['1ca6dbba-bcb4-4510-8d19-4f55a4959c63', '6724fe2d-2089-49d3-9475-bbf24e1cdf5e', 'b88db577-2584-4698-aecd-07e9be5907fe', '7090a559-a204-4118-92d0-65359d55f0c2'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:06 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85014190-8ae5-42a6-8d97-eb769c054f3c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0" returned: 0 in 0.397s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:06 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 is being set with open permissions: ugo+rw Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:06 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 Jul 23 03:22:06 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:06 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:06 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:06 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:06 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:07 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0" returned: 0 in 0.524s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:07 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.info Jul 23 03:22:07 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:07 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.631s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:07 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:07 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Deleted volume successfully. Jul 23 03:22:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.627s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:22:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 8 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:22:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:22:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-072ccd1c-a6c8-40b3-bebb-d8ba6d71a7f2 tempest-VolumesActionsTest-1957843986 None] Lock "cinder-3c7de2e6-b388-41e0-af8e-998c636fe6e7-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:07 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.info" returned: 0 in 0.580s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:08 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.info is being set with open permissions: ugo+rw Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:08 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.info Jul 23 03:22:08 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:08 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.info" returned: 0 in 0.486s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.620s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:08 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-a3ad00c5-7fc4-45c3-8628-1db933e09d35 req-065d27ed-75f0-4e74-ba6b-63365e72d77b tempest-VolumesSnapshotsTestJSON-270683931 None] Create snapshot completed successfully Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (9e6c09ea-0b23-43ec-ac2a-ee8cebe06fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bbf9d4-c083-41e2-86eb-c2798265941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bbf9d4-c083-41e2-86eb-c2798265941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-504830631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f30b698-e262-4d3d-9090-1b740d8489a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:09Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9516fc7-12db-41dc-9fae-d58b88b3f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9516fc7-12db-41dc-9fae-d58b88b3f651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9273f74a-5b12-430a-a556-7dd8f368c598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9273f74a-5b12-430a-a556-7dd8f368c598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f30b698-e262-4d3d-9090-1b740d8489a0', 'volume_name': 'volume-7f30b698-e262-4d3d-9090-1b740d8489a0', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab7a8e8-4df0-4d76-868e-d37469ca2abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab7a8e8-4df0-4d76-868e-d37469ca2abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6249a394-aa5e-4d79-a970-179ab05f872d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:08 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Volume 7f30b698-e262-4d3d-9090-1b740d8489a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f30b698-e262-4d3d-9090-1b740d8489a0', 'volume_size': 1} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-504830631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f30b698-e262-4d3d-9090-1b740d8489a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:09Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Creating volume 7f30b698-e262-4d3d-9090-1b740d8489a0 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:08 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:09 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0 1073741824 Jul 23 03:22:09 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:09 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0 1073741824" returned: 0 in 0.553s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:09 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0 Jul 23 03:22:09 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Acquiring lock "cinder-30eafd4d-fd36-4ad5-8f38-2627826aaab0-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "cinder-30eafd4d-fd36-4ad5-8f38-2627826aaab0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Acquiring lock "cinder-quobyte-85014190-8ae5-42a6-8d97-eb769c054f3c" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "cinder-quobyte-85014190-8ae5-42a6-8d97-eb769c054f3c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Acquiring lock "cinder-quobyte-30eafd4d-fd36-4ad5-8f38-2627826aaab0" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:09 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0" returned: 0 in 0.402s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "cinder-quobyte-30eafd4d-fd36-4ad5-8f38-2627826aaab0" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Deleting offline snapshot 30eafd4d-fd36-4ad5-8f38-2627826aaab0 of volume 85014190-8ae5-42a6-8d97-eb769c054f3c {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] snapshot_file for this snap is: volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6249a394-aa5e-4d79-a970-179ab05f872d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f30b698-e262-4d3d-9090-1b740d8489a0', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4af636-e20c-46b5-9a46-68a77f5e9ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f828f436-0704-4a6e-a999-d8e7267f12c8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:10 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Volume volume-7f30b698-e262-4d3d-9090-1b740d8489a0 (7f30b698-e262-4d3d-9090-1b740d8489a0): created successfully Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4af636-e20c-46b5-9a46-68a77f5e9ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (9e6c09ea-0b23-43ec-ac2a-ee8cebe06fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:10 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-dd1b6ea6-8f5c-4c23-a0cc-45296929d029 tempest-VolumesActionsTest-771004676 None] Created volume successfully. Jul 23 03:22:10 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 Jul 23 03:22:10 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:10 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0" returned: 0 in 0.585s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85014190-8ae5-42a6-8d97-eb769c054f3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff4a55d-8eae-45ec-924b-8acbfb8aea0c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:10 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c Jul 23 03:22:10 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Acquiring lock "cinder-7f30b698-e262-4d3d-9090-1b740d8489a0-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Lock "cinder-7f30b698-e262-4d3d-9090-1b740d8489a0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Acquiring lock "cinder-quobyte-7f30b698-e262-4d3d-9090-1b740d8489a0" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Lock "cinder-quobyte-7f30b698-e262-4d3d-9090-1b740d8489a0" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:11 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c" returned: 0 in 0.900s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:11 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4912e902-1e4d-4b6a-91d9-3fdc24bd210c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:11 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 Jul 23 03:22:11 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:11 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0 Jul 23 03:22:11 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:12 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0" returned: 0 in 0.683s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:12 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0" returned: 0 in 0.725s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:12 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0 Jul 23 03:22:12 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:12 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0 Jul 23 03:22:12 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:12 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c.30eafd4d-fd36-4ad5-8f38-2627826aaab0" returned: 0 in 0.425s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "cinder-quobyte-30eafd4d-fd36-4ad5-8f38-2627826aaab0" released by "_delete_snapshot" :: held 2.830s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "cinder-quobyte-85014190-8ae5-42a6-8d97-eb769c054f3c" released by "delete_snapshot" :: held 2.870s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:12 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7f30b698-e262-4d3d-9090-1b740d8489a0" returned: 0 in 0.573s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Lock "cinder-quobyte-7f30b698-e262-4d3d-9090-1b740d8489a0" released by "delete_volume" :: held 1.358s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:12 devstack cinder-volume[88392]: DEBUG cinder.quota [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Created reservations ['766f9225-8472-4e06-a069-e54127d856c3', '1cc64c49-76ba-4058-bba5-5f41f9218f20', '0082c3a1-ba15-4cc7-8a33-4dd843b26995', '1efcbb66-42df-4b82-9b89-1409130a0a00'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Created reservations ['98cdfa79-ffd3-4ddf-9bba-3c4779aed4a1', '98cc5643-1876-4dc4-b00f-4977bd5bbd40', '747e9f0f-42eb-46a5-990a-6afd7f896142', '2a6577bf-eba1-46df-8fa1-8d79c330d729'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Delete snapshot completed successfully. Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-aea5e7b3-d2b8-4e07-97a9-08b34e53c365 req-a59ceb14-b9e0-464d-9744-8f861f73bd5e tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "cinder-30eafd4d-fd36-4ad5-8f38-2627826aaab0-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:13 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:13 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Acquiring lock "cinder-85014190-8ae5-42a6-8d97-eb769c054f3c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:13 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.283s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Deleted volume successfully. Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "cinder-85014190-8ae5-42a6-8d97-eb769c054f3c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c305e1c2-fa4b-4157-9365-0e30464d884c tempest-VolumesActionsTest-1957843986 None] Lock "cinder-7f30b698-e262-4d3d-9090-1b740d8489a0-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Acquiring lock "cinder-quobyte-85014190-8ae5-42a6-8d97-eb769c054f3c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "cinder-quobyte-85014190-8ae5-42a6-8d97-eb769c054f3c" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[805cf318-c4da-40eb-b991-9d709ca04c77]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:13 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c Jul 23 03:22:13 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:14 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c" returned: 0 in 0.437s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:14 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c Jul 23 03:22:14 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:14 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85014190-8ae5-42a6-8d97-eb769c054f3c" returned: 0 in 0.367s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "cinder-quobyte-85014190-8ae5-42a6-8d97-eb769c054f3c" released by "delete_volume" :: held 0.882s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.quota [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Created reservations ['dd923ac8-7463-4c23-ad98-f1400b3e5ea6', 'f8a695e1-da3f-4cf8-b117-3160958c1563', '25ef3ae3-cb2b-4f81-99fd-e0a62f03412b', '3b66f2cf-13b9-41f0-8986-a95af1a03f37'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (37e932d8-54b3-4a30-8c6b-e18966041937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58ecd23-16db-444f-9c8f-c8f392ea335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58ecd23-16db-444f-9c8f-c8f392ea335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1710706012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:14Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7f5a11-7d00-463e-8f5c-45c999209d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7f5a11-7d00-463e-8f5c-45c999209d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dfa46e-51ff-4ff6-9f78-02396ea13123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84dfa46e-51ff-4ff6-9f78-02396ea13123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd', 'volume_name': 'volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c16a22e-2336-4d3b-b701-ca6064aff089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c16a22e-2336-4d3b-b701-ca6064aff089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f968247c-d8ab-423a-a311-f91ea61365fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:14 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Volume 47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd', 'volume_size': 1} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1710706012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f9bedc43e54cf6af9e2c39e0a5d356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:14Z,use_quota=True,user_id='6f697401d78f4b12ab90b040038bb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Creating volume 47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:14 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:14 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd 1073741824 Jul 23 03:22:14 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:14 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:14 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:15 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.371s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG cinder.manager [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Deleted volume successfully. Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-9a2b76bb-4dee-4ce0-b763-d310d7930dba req-efc7c2d4-6fe0-470b-b41d-5629599fc363 tempest-VolumesSnapshotsTestJSON-270683931 None] Lock "cinder-85014190-8ae5-42a6-8d97-eb769c054f3c-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:15 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd 1073741824" returned: 0 in 0.687s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:15 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd Jul 23 03:22:15 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:15 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd" returned: 0 in 0.391s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f968247c-d8ab-423a-a311-f91ea61365fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7c4c99-de7f-4566-8748-75769d2a3b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:15 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Volume volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd (47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd): created successfully Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7c4c99-de7f-4566-8748-75769d2a3b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Flow 'volume_create_manager' (37e932d8-54b3-4a30-8c6b-e18966041937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-51268788-cec0-47e5-b99e-098a02d53799 tempest-VolumesActionsTest-771004676 None] Created volume successfully. Jul 23 03:22:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Acquiring lock "cinder-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Lock "cinder-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:17 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=111,cinder:SELECT=121,cinder:INSERT=23,cinder:DELETE=8 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:22:17 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=121,cinder:UPDATE=137,cinder:DELETE=13,cinder:INSERT=31 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:22:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Acquiring lock "cinder-quobyte-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Lock "cinder-quobyte-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd" acquired by "delete_volume" :: waited 0.043s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:17 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ebee8b-8ab3-4fc6-b0ae-cdcc6e7df8ad]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:18 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd Jul 23 03:22:18 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:18 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd" returned: 0 in 0.687s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:18 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd Jul 23 03:22:18 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:18 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd" returned: 0 in 0.333s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Lock "cinder-quobyte-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd" released by "delete_volume" :: held 1.118s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:19 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Created reservations ['7404bbe3-c650-4990-9fd3-311826514943', '41821a26-dfa3-44a0-9578-ec81419466bf', 'bc9bf9c0-9275-4ac0-8336-d72706b060c3', '1477da04-250c-4f28-a940-097ceb949cc3'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:19 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:19 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:19 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.256s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:19 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:19 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Deleted volume successfully. Jul 23 03:22:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a8e6414d-8544-49e3-be3b-d8ed0e0a2b29 tempest-VolumesActionsTest-771004676 None] Lock "cinder-47b9e2ed-9e77-4b75-ae94-b0b069a1c1cd-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Flow 'volume_create_manager' (a3e806ce-32b2-479b-a843-a57968c0c68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9810a9-2b74-438a-ad95-ca11a0801ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9810a9-2b74-438a-ad95-ca11a0801ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1633253042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817a901b-55f0-4ed3-a511-8a1c61b7622f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bdb27a5609a747c8a0c28878583b956b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:20Z,use_quota=True,user_id='c82316bc19ca4f1e8e2ab74d06c76c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cc0a80-1298-470d-9bc4-8536e29dd381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cc0a80-1298-470d-9bc4-8536e29dd381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5418a0-a5ae-4702-909b-c050c1e3aca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5418a0-a5ae-4702-909b-c050c1e3aca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817a901b-55f0-4ed3-a511-8a1c61b7622f', 'volume_name': 'volume-817a901b-55f0-4ed3-a511-8a1c61b7622f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f9a8a0-d49f-4fe8-89af-1bf48207d87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f9a8a0-d49f-4fe8-89af-1bf48207d87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3791d939-e450-4b04-b823-8921977d1497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:20 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Volume 817a901b-55f0-4ed3-a511-8a1c61b7622f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817a901b-55f0-4ed3-a511-8a1c61b7622f', 'volume_size': 1} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1633253042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817a901b-55f0-4ed3-a511-8a1c61b7622f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bdb27a5609a747c8a0c28878583b956b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:20Z,use_quota=True,user_id='c82316bc19ca4f1e8e2ab74d06c76c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Creating volume 817a901b-55f0-4ed3-a511-8a1c61b7622f {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:20 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:20 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f 1073741824 Jul 23 03:22:20 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:21 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f 1073741824" returned: 0 in 0.480s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:21 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f Jul 23 03:22:21 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:21 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f" returned: 0 in 0.393s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3791d939-e450-4b04-b823-8921977d1497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817a901b-55f0-4ed3-a511-8a1c61b7622f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc939dcf-f11d-45e3-b36a-2dedd857ad07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:21 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Volume volume-817a901b-55f0-4ed3-a511-8a1c61b7622f (817a901b-55f0-4ed3-a511-8a1c61b7622f): created successfully Jul 23 03:22:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc939dcf-f11d-45e3-b36a-2dedd857ad07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Flow 'volume_create_manager' (a3e806ce-32b2-479b-a843-a57968c0c68c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:21 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-50aca941-61e1-4c7a-b77d-fd5b2b277946 tempest-VolumesTestJSON-928915195 None] Created volume successfully. Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Flow 'volume_create_manager' (5ac5fc41-b316-432e-8569-9682c4b90102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb0b914-2a36-440d-890c-415d802b931c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb0b914-2a36-440d-890c-415d802b931c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-523602115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bdb27a5609a747c8a0c28878583b956b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:23Z,use_quota=True,user_id='c82316bc19ca4f1e8e2ab74d06c76c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd645f98-3be3-4579-a7b1-9c64f9092bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd645f98-3be3-4579-a7b1-9c64f9092bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c70b9fa-8da7-4962-ae49-310bd0608941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c70b9fa-8da7-4962-ae49-310bd0608941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba', 'volume_name': 'volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4da6343-ecdc-41cc-afcc-61769a5791f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4da6343-ecdc-41cc-afcc-61769a5791f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd8454b-81fc-41a3-8905-3c8adbf01e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:23 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Volume 04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba', 'volume_size': 1} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-523602115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bdb27a5609a747c8a0c28878583b956b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:23Z,use_quota=True,user_id='c82316bc19ca4f1e8e2ab74d06c76c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Creating volume 04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:23 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:23 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba 1073741824 Jul 23 03:22:23 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:23 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba 1073741824" returned: 0 in 0.615s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:24 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba Jul 23 03:22:24 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:24 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba" returned: 0 in 0.268s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd8454b-81fc-41a3-8905-3c8adbf01e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7167a9-7f43-45c2-96bf-4db8dd3be5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:24 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Volume volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba (04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba): created successfully Jul 23 03:22:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7167a9-7f43-45c2-96bf-4db8dd3be5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Flow 'volume_create_manager' (5ac5fc41-b316-432e-8569-9682c4b90102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:24 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-17a1831c-9faa-4585-bf6f-01d07aaa4640 tempest-VolumesTestJSON-928915195 None] Created volume successfully. Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Flow 'volume_create_manager' (5573c905-e08b-410e-8109-9768b371c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc444402-5ae6-4132-9179-b387b7ed1bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc444402-5ae6-4132-9179-b387b7ed1bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1814050614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d33576-e81c-47f8-97e1-1c90475a54ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bdb27a5609a747c8a0c28878583b956b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:26Z,use_quota=True,user_id='c82316bc19ca4f1e8e2ab74d06c76c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689e27a6-4d8f-4292-a7cf-c345c3b0dfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689e27a6-4d8f-4292-a7cf-c345c3b0dfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95364fd-1f71-494d-bee6-c24342d8a48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95364fd-1f71-494d-bee6-c24342d8a48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d33576-e81c-47f8-97e1-1c90475a54ba', 'volume_name': 'volume-c5d33576-e81c-47f8-97e1-1c90475a54ba', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab36f1cc-3fe0-4725-9b6c-d35c8c3fbe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab36f1cc-3fe0-4725-9b6c-d35c8c3fbe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13cdbcd-7c46-43df-a336-671c7708d890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:25 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Volume c5d33576-e81c-47f8-97e1-1c90475a54ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d33576-e81c-47f8-97e1-1c90475a54ba', 'volume_size': 1} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1814050614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d33576-e81c-47f8-97e1-1c90475a54ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bdb27a5609a747c8a0c28878583b956b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:26Z,use_quota=True,user_id='c82316bc19ca4f1e8e2ab74d06c76c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Creating volume c5d33576-e81c-47f8-97e1-1c90475a54ba {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:25 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:26 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba 1073741824 Jul 23 03:22:26 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:26 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba 1073741824" returned: 0 in 0.427s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:26 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba Jul 23 03:22:26 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:26 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba" returned: 0 in 0.235s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13cdbcd-7c46-43df-a336-671c7708d890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d33576-e81c-47f8-97e1-1c90475a54ba', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1e464a-da8c-42a7-ac80-3a8ad326a663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:26 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Volume volume-c5d33576-e81c-47f8-97e1-1c90475a54ba (c5d33576-e81c-47f8-97e1-1c90475a54ba): created successfully Jul 23 03:22:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1e464a-da8c-42a7-ac80-3a8ad326a663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Flow 'volume_create_manager' (5573c905-e08b-410e-8109-9768b371c69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:26 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-249b4c86-918c-403f-a563-835938d7d6ec tempest-VolumesTestJSON-928915195 None] Created volume successfully. Jul 23 03:22:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Acquiring lock "cinder-c5d33576-e81c-47f8-97e1-1c90475a54ba-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Lock "cinder-c5d33576-e81c-47f8-97e1-1c90475a54ba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Acquiring lock "cinder-quobyte-c5d33576-e81c-47f8-97e1-1c90475a54ba" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Lock "cinder-quobyte-c5d33576-e81c-47f8-97e1-1c90475a54ba" acquired by "delete_volume" :: waited 0.030s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:27 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a2ffcd-6f02-4cc5-8d82-b53a72ded9fe]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:28 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba Jul 23 03:22:28 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:28 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba" returned: 0 in 0.386s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:28 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba Jul 23 03:22:28 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:28 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5d33576-e81c-47f8-97e1-1c90475a54ba" returned: 0 in 0.240s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Lock "cinder-quobyte-c5d33576-e81c-47f8-97e1-1c90475a54ba" released by "delete_volume" :: held 0.673s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:28 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Created reservations ['2f7aabd4-e87d-4f4b-906c-eb9f4131622e', '5c5beeb8-d89a-4261-a236-ae5aaa09a075', '214f9b04-6cc4-435e-86c5-663a7ec7512b', '28199f25-960d-4094-86e5-dc72579ccacf'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:28 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:28 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Acquiring lock "cinder-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:29 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.330s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:29 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Deleted volume successfully. Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Lock "cinder-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29f2641d-50e8-4ede-98f9-aaf5518740e9 tempest-VolumesTestJSON-928915195 None] Lock "cinder-c5d33576-e81c-47f8-97e1-1c90475a54ba-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Acquiring lock "cinder-quobyte-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Lock "cinder-quobyte-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[452986d2-c81a-4463-8318-912184ed75a9]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:29 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba Jul 23 03:22:29 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:29 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba" returned: 0 in 0.415s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:29 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba Jul 23 03:22:29 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:29 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba" returned: 0 in 0.383s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Lock "cinder-quobyte-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba" released by "delete_volume" :: held 0.851s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Created reservations ['d733533c-081a-4c9d-a984-7590c34964dc', 'bc6a5ff0-67c0-452a-8c70-2ceafc94803a', 'ce628f2a-a888-4655-9ed7-9ae821916ebd', '752aa805-6c47-497b-b83d-0ee4d71b050f'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:30 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:30 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Acquiring lock "cinder-817a901b-55f0-4ed3-a511-8a1c61b7622f-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Lock "cinder-817a901b-55f0-4ed3-a511-8a1c61b7622f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Acquiring lock "cinder-quobyte-817a901b-55f0-4ed3-a511-8a1c61b7622f" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Lock "cinder-quobyte-817a901b-55f0-4ed3-a511-8a1c61b7622f" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e98e35-d5ba-4a57-aa77-53212dee18af]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:30 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f Jul 23 03:22:30 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:30 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.331s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Deleted volume successfully. Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9a2ced09-e224-4054-b32b-a8f78338fb99 tempest-VolumesTestJSON-928915195 None] Lock "cinder-04b18bc5-6508-44f5-a10d-a5e6dc1ba4ba-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:30 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f" returned: 0 in 0.378s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:30 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f Jul 23 03:22:30 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:31 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-817a901b-55f0-4ed3-a511-8a1c61b7622f" returned: 0 in 0.279s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Lock "cinder-quobyte-817a901b-55f0-4ed3-a511-8a1c61b7622f" released by "delete_volume" :: held 0.703s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Created reservations ['62e87419-a07a-4805-b4bb-75abef4fac76', 'bbf69033-55e4-413b-8a5e-6c81cf7110f5', '88e9cccd-f221-4472-9b5a-fd2d199b32ed', 'c39df6cd-8301-4506-a58a-067decac98ee'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:31 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:31 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:31 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.273s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:31 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Deleted volume successfully. Jul 23 03:22:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ae12ef7-a828-46c9-891c-d5b32ace8264 tempest-VolumesTestJSON-928915195 None] Lock "cinder-817a901b-55f0-4ed3-a511-8a1c61b7622f-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Flow 'volume_create_manager' (df191ed0-9316-4444-9501-b1ada687f50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6538c14a-984d-4b1c-be49-51f3c8c6cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6538c14a-984d-4b1c-be49-51f3c8c6cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1381191357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75732ee6-9b7e-4e7a-b866-060deb7710b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045f6a0c076f4c3485b6cf76874440df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:32Z,use_quota=True,user_id='972b5a0a8e0144dc9e60137a75354a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e6fac2-5ac2-4254-bb1c-62c780d244a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e6fac2-5ac2-4254-bb1c-62c780d244a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04670d9b-f028-4fe8-99e8-66632d03f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04670d9b-f028-4fe8-99e8-66632d03f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75732ee6-9b7e-4e7a-b866-060deb7710b4', 'volume_name': 'volume-75732ee6-9b7e-4e7a-b866-060deb7710b4', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8150abaf-c1e5-420c-a425-181117a37011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8150abaf-c1e5-420c-a425-181117a37011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c624d4e-e3a3-43e4-a99a-128100536606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:32 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Volume 75732ee6-9b7e-4e7a-b866-060deb7710b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75732ee6-9b7e-4e7a-b866-060deb7710b4', 'volume_size': 1} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1381191357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75732ee6-9b7e-4e7a-b866-060deb7710b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045f6a0c076f4c3485b6cf76874440df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:32Z,use_quota=True,user_id='972b5a0a8e0144dc9e60137a75354a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Creating volume 75732ee6-9b7e-4e7a-b866-060deb7710b4 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:32 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:32 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4 1073741824 Jul 23 03:22:32 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:33 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4 1073741824" returned: 0 in 0.556s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:33 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4 Jul 23 03:22:33 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:33 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4" returned: 0 in 0.298s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c624d4e-e3a3-43e4-a99a-128100536606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75732ee6-9b7e-4e7a-b866-060deb7710b4', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f75564-5528-4ad7-9751-57ba75f2039e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Flow 'volume_create_manager' (292dcb96-ce88-4ae3-9179-1965828d9bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e46fa5-870f-4373-af75-95b499bce14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:33 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Volume volume-75732ee6-9b7e-4e7a-b866-060deb7710b4 (75732ee6-9b7e-4e7a-b866-060deb7710b4): created successfully Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f75564-5528-4ad7-9751-57ba75f2039e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Flow 'volume_create_manager' (df191ed0-9316-4444-9501-b1ada687f50f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e46fa5-870f-4373-af75-95b499bce14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1701704165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a06438a-9bf3-4f36-9a19-3e15a0ea29c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e79d70933f48b98dd621983f3a5d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:33Z,use_quota=True,user_id='6367756e2cb240b69ca8dad6cb554037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ffc4239-96ef-4608-ac3c-ea2423f3f77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ffc4239-96ef-4608-ac3c-ea2423f3f77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88694f9b-1b5e-4095-a202-2ec5cd5172d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88694f9b-1b5e-4095-a202-2ec5cd5172d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a06438a-9bf3-4f36-9a19-3e15a0ea29c0', 'volume_name': 'volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee578b5-aec3-42a5-9346-d2ed6ed622e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee578b5-aec3-42a5-9346-d2ed6ed622e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5483c63-a4bc-4f04-b5d1-f522306b4528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:33 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Volume 6a06438a-9bf3-4f36-9a19-3e15a0ea29c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0', 'volume_size': 1} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1701704165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a06438a-9bf3-4f36-9a19-3e15a0ea29c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e79d70933f48b98dd621983f3a5d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:33Z,use_quota=True,user_id='6367756e2cb240b69ca8dad6cb554037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Creating volume 6a06438a-9bf3-4f36-9a19-3e15a0ea29c0 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:33 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:33 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-425125cf-c7a4-4ee7-bcf8-bd69303295ca tempest-AttachVolumeNegativeTest-985906857 None] Created volume successfully. Jul 23 03:22:33 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0 1073741824 Jul 23 03:22:33 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:34 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0 1073741824" returned: 0 in 0.509s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:34 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0 Jul 23 03:22:34 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:34 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0" returned: 0 in 0.280s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5483c63-a4bc-4f04-b5d1-f522306b4528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ef7003-e860-43f4-a224-36db0c138945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:34 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Volume volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0 (6a06438a-9bf3-4f36-9a19-3e15a0ea29c0): created successfully Jul 23 03:22:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ef7003-e860-43f4-a224-36db0c138945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Flow 'volume_create_manager' (292dcb96-ce88-4ae3-9179-1965828d9bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:34 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2ce2bba4-e326-49ea-9423-811943fdb2ee tempest-VolumesListAdminTestJSON-2043786691 None] Created volume successfully. Jul 23 03:22:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-b6d82fce-437e-46c5-8bfd-7ae5bec24caf req-7f855189-e508-448b-b70a-a8f957d270e4 tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-b6d82fce-437e-46c5-8bfd-7ae5bec24caf req-7f855189-e508-448b-b70a-a8f957d270e4 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-b6d82fce-437e-46c5-8bfd-7ae5bec24caf req-7f855189-e508-448b-b70a-a8f957d270e4 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-b6d82fce-437e-46c5-8bfd-7ae5bec24caf req-7f855189-e508-448b-b70a-a8f957d270e4 tempest-AttachVolumeNegativeTest-985906857 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-75732ee6-9b7e-4e7a-b866-060deb7710b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd75d748f-b78e-4822-9cf4-3fb22ce3ce4f', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:22:35 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-b6d82fce-437e-46c5-8bfd-7ae5bec24caf req-7f855189-e508-448b-b70a-a8f957d270e4 tempest-AttachVolumeNegativeTest-985906857 None] attachment_update completed successfully. Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Flow 'volume_create_manager' (f03c2c15-1176-4207-8fa1-c3e1f06bf22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b749c27-b2fd-45c7-977b-5a8d7b058b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b749c27-b2fd-45c7-977b-5a8d7b058b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1795672508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c93e8b-b578-420d-b2a3-0a6e26e634e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e79d70933f48b98dd621983f3a5d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:36Z,use_quota=True,user_id='6367756e2cb240b69ca8dad6cb554037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc34fbf-4d06-429c-a6fc-fc5fdb062d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc34fbf-4d06-429c-a6fc-fc5fdb062d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd19f64-e943-4c24-ab98-6ea8c9eeef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd19f64-e943-4c24-ab98-6ea8c9eeef09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c93e8b-b578-420d-b2a3-0a6e26e634e3', 'volume_name': 'volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08555d80-0f8b-422f-8ae0-7009c8dcb8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08555d80-0f8b-422f-8ae0-7009c8dcb8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24097664-f4fd-486c-a673-bf31f7660076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:36 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Volume 81c93e8b-b578-420d-b2a3-0a6e26e634e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3', 'volume_size': 1} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1795672508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c93e8b-b578-420d-b2a3-0a6e26e634e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e79d70933f48b98dd621983f3a5d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:36Z,use_quota=True,user_id='6367756e2cb240b69ca8dad6cb554037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Creating volume 81c93e8b-b578-420d-b2a3-0a6e26e634e3 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:36 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:36 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3 1073741824 Jul 23 03:22:36 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-d014ab50-a5c7-4ed9-8dc5-a4f803d107bf req-536627c3-43d1-4e4f-b775-eadab48b416d tempest-ServerActionsTestOtherA-1993422336 None] Terminate volume connection completed successfully. Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-d014ab50-a5c7-4ed9-8dc5-a4f803d107bf req-536627c3-43d1-4e4f-b775-eadab48b416d tempest-ServerActionsTestOtherA-1993422336 None] Deleting attachment abcba1ec-7f2b-4d3a-852c-47c9fcf70976. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:22:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5c0d5e4a-0328-4094-824a-6c3712c55a5e tempest-GroupSnapshotsTest-2072320542 None] Group tempest-GroupSnapshotsTest-Group-739903121: creating Jul 23 03:22:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5c0d5e4a-0328-4094-824a-6c3712c55a5e tempest-GroupSnapshotsTest-2072320542 None] Group tempest-GroupSnapshotsTest-Group-739903121: created successfully Jul 23 03:22:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5c0d5e4a-0328-4094-824a-6c3712c55a5e tempest-GroupSnapshotsTest-2072320542 None] Create group completed successfully. Jul 23 03:22:36 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3 1073741824" returned: 0 in 0.425s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:36 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3 Jul 23 03:22:36 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:37 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3" returned: 0 in 0.250s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24097664-f4fd-486c-a673-bf31f7660076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77572b9-fdee-485a-9136-91288b7f59c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:37 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Volume volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3 (81c93e8b-b578-420d-b2a3-0a6e26e634e3): created successfully Jul 23 03:22:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77572b9-fdee-485a-9136-91288b7f59c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Flow 'volume_create_manager' (f03c2c15-1176-4207-8fa1-c3e1f06bf22c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:37 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9e6beb5a-8daa-48ed-a756-26c33a27e849 tempest-VolumesListAdminTestJSON-2043786691 None] Created volume successfully. Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Flow 'volume_create_manager' (27b5a8d6-51ed-466b-be51-fb56680112f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2fffde-18aa-4da4-be46-a80ae369f264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2fffde-18aa-4da4-be46-a80ae369f264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1095507933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51a02922-02e7-4b1f-b63e-9962b79f1471,host='devstack@QuobyteHD#QuobyteHD',id=5212a8d0-62c7-490b-a2c9-278179ab28e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4750d23d031e4c6a827c68ded1f9eca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:38Z,use_quota=True,user_id='3bb301e739e548e0a2e70d5680340abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa051c6d-f02a-41bf-a7a1-cb70a18c6045),volume_type_id=fa051c6d-f02a-41bf-a7a1-cb70a18c6045)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8190faa7-c7a8-4ece-a2bf-4a957bc5627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8190faa7-c7a8-4ece-a2bf-4a957bc5627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237bfd5e-1ef7-4d6d-a993-c143c3d63053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237bfd5e-1ef7-4d6d-a993-c143c3d63053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5212a8d0-62c7-490b-a2c9-278179ab28e4', 'volume_name': 'volume-5212a8d0-62c7-490b-a2c9-278179ab28e4', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e7cb3c-2357-4b40-affd-13a58995ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e7cb3c-2357-4b40-affd-13a58995ac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7ebb32-7317-471d-bf3a-4ad3920d754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:38 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Volume 5212a8d0-62c7-490b-a2c9-278179ab28e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5212a8d0-62c7-490b-a2c9-278179ab28e4', 'volume_size': 1} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51a02922-02e7-4b1f-b63e-9962b79f1471,created_at=2026-07-23T01:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1095507933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51a02922-02e7-4b1f-b63e-9962b79f1471,host='devstack@QuobyteHD#QuobyteHD',id=5212a8d0-62c7-490b-a2c9-278179ab28e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4750d23d031e4c6a827c68ded1f9eca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:38Z,use_quota=True,user_id='3bb301e739e548e0a2e70d5680340abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa051c6d-f02a-41bf-a7a1-cb70a18c6045),volume_type_id=fa051c6d-f02a-41bf-a7a1-cb70a18c6045)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Creating volume 5212a8d0-62c7-490b-a2c9-278179ab28e4 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:38 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:38 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 1073741824 Jul 23 03:22:38 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:38 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-b2e62c94-fb8a-419b-a304-1b7cd7c8c04c req-523c100c-f216-42a4-9e80-ad053f13966b tempest-AttachVolumeNegativeTest-985906857 None] Terminate volume connection completed successfully. Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-b2e62c94-fb8a-419b-a304-1b7cd7c8c04c req-523c100c-f216-42a4-9e80-ad053f13966b tempest-AttachVolumeNegativeTest-985906857 None] Deleting attachment d75d748f-b78e-4822-9cf4-3fb22ce3ce4f. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:22:38 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 1073741824" returned: 0 in 0.647s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:39 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 Jul 23 03:22:39 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Flow 'volume_create_manager' (cc51ddae-68b0-40d8-a239-4fcec6e8f2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d533b1-63db-4847-9383-12641fdec9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d533b1-63db-4847-9383-12641fdec9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1698554720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac44b848-540d-42af-b180-d4a359fe981d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e79d70933f48b98dd621983f3a5d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:39Z,use_quota=True,user_id='6367756e2cb240b69ca8dad6cb554037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:39 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5710e1-17a2-458c-9e45-49d7513cd427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5710e1-17a2-458c-9e45-49d7513cd427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200965a3-afef-48e2-9c5e-6ae1782e883f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200965a3-afef-48e2-9c5e-6ae1782e883f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac44b848-540d-42af-b180-d4a359fe981d', 'volume_name': 'volume-ac44b848-540d-42af-b180-d4a359fe981d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1399ea-2045-4b12-9e88-a382bd20db29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1399ea-2045-4b12-9e88-a382bd20db29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4b104a-e1af-45a2-8d18-34eda4d5a63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Volume ac44b848-540d-42af-b180-d4a359fe981d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac44b848-540d-42af-b180-d4a359fe981d', 'volume_size': 1} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4" returned: 0 in 0.636s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1698554720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac44b848-540d-42af-b180-d4a359fe981d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e79d70933f48b98dd621983f3a5d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:39Z,use_quota=True,user_id='6367756e2cb240b69ca8dad6cb554037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Creating volume ac44b848-540d-42af-b180-d4a359fe981d {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:39 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:39 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d 1073741824 Jul 23 03:22:39 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7ebb32-7317-471d-bf3a-4ad3920d754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5212a8d0-62c7-490b-a2c9-278179ab28e4', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827c39c5-270a-455c-91a8-318af89bee73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Volume volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 (5212a8d0-62c7-490b-a2c9-278179ab28e4): created successfully Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827c39c5-270a-455c-91a8-318af89bee73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Flow 'volume_create_manager' (27b5a8d6-51ed-466b-be51-fb56680112f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-eb1d1b47-9b9d-4a0a-bb31-64d3fdb60c01 tempest-GroupSnapshotsTest-2072320542 None] Created volume successfully. Jul 23 03:22:40 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d 1073741824" returned: 0 in 0.674s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:40 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d Jul 23 03:22:40 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:40 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d" returned: 0 in 0.285s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4b104a-e1af-45a2-8d18-34eda4d5a63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac44b848-540d-42af-b180-d4a359fe981d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c5a79d-a1b5-4821-a649-49d01d89f705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Volume volume-ac44b848-540d-42af-b180-d4a359fe981d (ac44b848-540d-42af-b180-d4a359fe981d): created successfully Jul 23 03:22:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c5a79d-a1b5-4821-a649-49d01d89f705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Flow 'volume_create_manager' (cc51ddae-68b0-40d8-a239-4fcec6e8f2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:40 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ca62b263-582b-4e16-b1b4-ddc2d6819c6e tempest-VolumesListAdminTestJSON-2043786691 None] Created volume successfully. Jul 23 03:22:41 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] GroupSnapshot 12f9626b-ca9e-43c7-a2d4-160995f71f24: creating. Jul 23 03:22:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] Group snapshot 12f9626b-ca9e-43c7-a2d4-160995f71f24: creating. {{(pid=88392) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:22:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] Creating offline snapshot e019f8b5-7aae-4de0-b914-c5cd89ab0f5f of volume 5212a8d0-62c7-490b-a2c9-278179ab28e4 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:22:41 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[241ac020-2313-4f17-8723-fda7163eaa87]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:41 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 Jul 23 03:22:41 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:41 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4" returned: 0 in 0.525s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:41 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f 1G Jul 23 03:22:41 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:42 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f 1G" returned: 0 in 0.548s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:42 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f Jul 23 03:22:42 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Flow 'volume_create_manager' (e7d18344-65d5-4c0e-a97c-292e957fd048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af718ae2-106f-41bf-82c5-7fa6b46ade9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af718ae2-106f-41bf-82c5-7fa6b46ade9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d336f9-bb3b-4554-bf06-a5e919898535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c082f448f424b5a841e045f72923bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:42Z,use_quota=True,user_id='60d1b9ee96cb42a0b010db4d36dfdb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3ab4ab-435b-457e-a7bd-6083660809e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3ab4ab-435b-457e-a7bd-6083660809e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77d951b-1ebd-460d-adb9-8df9ba39af27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77d951b-1ebd-460d-adb9-8df9ba39af27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d336f9-bb3b-4554-bf06-a5e919898535', 'volume_name': 'volume-f8d336f9-bb3b-4554-bf06-a5e919898535', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0d2e11-e51b-4c06-b3ef-e3aceff53b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0d2e11-e51b-4c06-b3ef-e3aceff53b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3afe12-5a74-48d0-b46f-ec824c8a359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:42 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Volume f8d336f9-bb3b-4554-bf06-a5e919898535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d336f9-bb3b-4554-bf06-a5e919898535', 'volume_size': 1} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:42 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f" returned: 0 in 0.287s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:42 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:42 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f Jul 23 03:22:42 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:42 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f" returned: 0 in 0.251s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:42 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.info Jul 23 03:22:42 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:43 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.info" returned: 0 in 0.289s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:43 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:43 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.info Jul 23 03:22:43 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:43 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.info" returned: 0 in 0.265s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.901s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d336f9-bb3b-4554-bf06-a5e919898535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c082f448f424b5a841e045f72923bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:22:42Z,use_quota=True,user_id='60d1b9ee96cb42a0b010db4d36dfdb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Creating volume f8d336f9-bb3b-4554-bf06-a5e919898535 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:43 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:43 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535 1073741824 Jul 23 03:22:43 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:43 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9d5082c7-1138-429f-84d2-52410fb1c1c1 tempest-GroupSnapshotsTest-2072320542 None] group_snapshot 12f9626b-ca9e-43c7-a2d4-160995f71f24: created successfully Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Acquiring lock "cinder-d7b03c3d-ce35-4b88-bfc7-1edbc551945e-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Lock "cinder-d7b03c3d-ce35-4b88-bfc7-1edbc551945e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "cinder-75732ee6-9b7e-4e7a-b866-060deb7710b4-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Acquiring lock "cinder-quobyte-d7b03c3d-ce35-4b88-bfc7-1edbc551945e" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-75732ee6-9b7e-4e7a-b866-060deb7710b4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Lock "cinder-quobyte-d7b03c3d-ce35-4b88-bfc7-1edbc551945e" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d74fb6b-ceae-43dd-9db9-c4b7b4244dbb]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "cinder-quobyte-75732ee6-9b7e-4e7a-b866-060deb7710b4" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-quobyte-75732ee6-9b7e-4e7a-b866-060deb7710b4" acquired by "delete_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[70293047-8f8b-4f7f-9faa-a48435d950ed]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:43 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535 1073741824" returned: 0 in 0.581s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:44 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e Jul 23 03:22:44 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:44 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535 Jul 23 03:22:44 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:44 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4 Jul 23 03:22:44 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:44 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535" returned: 0 in 0.272s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3afe12-5a74-48d0-b46f-ec824c8a359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d336f9-bb3b-4554-bf06-a5e919898535', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894f5d2e-4feb-4dab-bd53-2c96b36b8149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:22:44 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e" returned: 0 in 0.443s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:44 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Volume volume-f8d336f9-bb3b-4554-bf06-a5e919898535 (f8d336f9-bb3b-4554-bf06-a5e919898535): created successfully Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894f5d2e-4feb-4dab-bd53-2c96b36b8149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:22:44 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e Jul 23 03:22:44 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Flow 'volume_create_manager' (e7d18344-65d5-4c0e-a97c-292e957fd048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:22:44 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4" returned: 0 in 0.401s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a61301e5-4a1b-42c1-a3f0-ca60521d04a0 tempest-VolumesListAdminTestJSON-1688557331 None] Created volume successfully. Jul 23 03:22:44 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4 Jul 23 03:22:44 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:44 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d7b03c3d-ce35-4b88-bfc7-1edbc551945e" returned: 0 in 0.276s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Lock "cinder-quobyte-d7b03c3d-ce35-4b88-bfc7-1edbc551945e" released by "delete_volume" :: held 0.773s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Acquiring lock "cinder-f8d336f9-bb3b-4554-bf06-a5e919898535-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Lock "cinder-f8d336f9-bb3b-4554-bf06-a5e919898535-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Created reservations ['0a1c01bf-61b7-4a25-96b4-3489bd5de113', '870c86e5-f388-4b5b-952d-b02579972b20', '21a8f493-c4b1-4980-ba6f-df8f0f59eed4', 'bee2af3d-9ce5-4d71-b1f1-620559002b49'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Acquiring lock "cinder-quobyte-f8d336f9-bb3b-4554-bf06-a5e919898535" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:44 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-75732ee6-9b7e-4e7a-b866-060deb7710b4" returned: 0 in 0.397s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Lock "cinder-quobyte-f8d336f9-bb3b-4554-bf06-a5e919898535" acquired by "delete_volume" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-quobyte-75732ee6-9b7e-4e7a-b866-060deb7710b4" released by "delete_volume" :: held 0.889s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "cinder-ac44b848-540d-42af-b180-d4a359fe981d-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56b078a-a965-44d0-8130-6d5d9eb53dee]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-ac44b848-540d-42af-b180-d4a359fe981d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:45 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "cinder-quobyte-ac44b848-540d-42af-b180-d4a359fe981d" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:45 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:45 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535 Jul 23 03:22:45 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Created reservations ['3d214960-c65f-4e18-a3b4-92f20b7eb3be', '6dbc3835-0daa-4b69-8383-389b14857fa9', '4ae9f6d6-2196-4275-98ac-40142785d8ee', '0fd2b335-5232-4ee2-a50a-129eaa516c2a'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-quobyte-ac44b848-540d-42af-b180-d4a359fe981d" acquired by "delete_volume" :: waited 0.042s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd87061-997d-4b71-b976-f8b590f3cc34]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:45 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d Jul 23 03:22:45 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:45 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:45 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:45 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535" returned: 0 in 0.606s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:45 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.472s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:45 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535 Jul 23 03:22:45 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Deleted volume successfully. Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f6faf3cc-ce2e-4046-a0a2-af32df186ad0 tempest-ServerActionsTestOtherA-1993422336 None] Lock "cinder-d7b03c3d-ce35-4b88-bfc7-1edbc551945e-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-e019f8b5-7aae-4de0-b914-c5cd89ab0f5f-0366fec5-5170-4681-b436-2bb9ceaaca07" by "_create_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-e019f8b5-7aae-4de0-b914-c5cd89ab0f5f-0366fec5-5170-4681-b436-2bb9ceaaca07" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Creating volume 0366fec5-5170-4681-b436-2bb9ceaaca07 from snapshot e019f8b5-7aae-4de0-b914-c5cd89ab0f5f {{(pid=88392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-0366fec5-5170-4681-b436-2bb9ceaaca07" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-0366fec5-5170-4681-b436-2bb9ceaaca07" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] snapshot: e019f8b5-7aae-4de0-b914-c5cd89ab0f5f, volume: 0366fec5-5170-4681-b436-2bb9ceaaca07, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:22:45 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.448s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Deleted volume successfully. Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ef715a-5db0-4850-a00b-867a9c6180b3]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cbaaff-ac8d-4c24-bcb0-44767d59c348 tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-75732ee6-9b7e-4e7a-b866-060deb7710b4-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:45 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d" returned: 0 in 0.719s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:45 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d Jul 23 03:22:45 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:45 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f8d336f9-bb3b-4554-bf06-a5e919898535" returned: 0 in 0.574s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:46 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f Jul 23 03:22:46 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Lock "cinder-quobyte-f8d336f9-bb3b-4554-bf06-a5e919898535" released by "delete_volume" :: held 1.306s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Created reservations ['f406f39d-d64e-4ebc-bdcb-41a5a4953be9', 'bb989bf9-acd4-4009-bc36-095799ec48d9', '3230bb4a-9865-4ae2-a482-349603832394', 'f1b299a2-aea4-400f-9130-ef3555c88566'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:46 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ac44b848-540d-42af-b180-d4a359fe981d" returned: 0 in 0.521s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-quobyte-ac44b848-540d-42af-b180-d4a359fe981d" released by "delete_volume" :: held 1.333s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:46 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:46 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Created reservations ['ac7c7843-42e5-49b9-b721-d8c858573678', 'b88c8750-647b-4a3a-8746-b8a777374c82', '559aa87f-4a50-4a5f-a64f-fabd34208216', 'db8111dd-ba51-47ab-9503-a947efe7bf83'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "cinder-50937964-8849-4574-bbd3-10816f317e25-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-50937964-8849-4574-bbd3-10816f317e25-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:46 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f" returned: 0 in 0.850s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5212a8d0-62c7-490b-a2c9-278179ab28e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f411f-78ca-4180-838c-54b2bff6b9ac]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "cinder-quobyte-50937964-8849-4574-bbd3-10816f317e25" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-quobyte-50937964-8849-4574-bbd3-10816f317e25" acquired by "delete_volume" :: waited 0.045s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:46 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:46 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e890a6-4d26-4998-b5ae-25986585344e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:46 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 Jul 23 03:22:46 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:46 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.383s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Deleted volume successfully. Jul 23 03:22:46 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25 Jul 23 03:22:46 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1881f11a-bc72-4eb6-b51d-f502ad60f5ed tempest-VolumesListAdminTestJSON-1688557331 None] Lock "cinder-f8d336f9-bb3b-4554-bf06-a5e919898535-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:47 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.369s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Deleted volume successfully. Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-923f9f22-250f-42e7-a6d3-2322809d9473 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-ac44b848-540d-42af-b180-d4a359fe981d-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:47 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4" returned: 0 in 0.533s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07 not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:47 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07 Jul 23 03:22:47 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:47 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25" returned: 0 in 0.521s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:47 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25 Jul 23 03:22:47 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "cinder-81c93e8b-b578-420d-b2a3-0a6e26e634e3-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-81c93e8b-b578-420d-b2a3-0a6e26e634e3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "cinder-quobyte-81c93e8b-b578-420d-b2a3-0a6e26e634e3" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-quobyte-81c93e8b-b578-420d-b2a3-0a6e26e634e3" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b491c00b-6d28-4d9c-a6eb-6b9d085e554b]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:47 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-50937964-8849-4574-bbd3-10816f317e25" returned: 0 in 0.395s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-quobyte-50937964-8849-4574-bbd3-10816f317e25" released by "delete_volume" :: held 0.977s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:47 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3 Jul 23 03:22:47 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Created reservations ['85641644-d833-4bfc-8ed6-01487322364b', 'faae29f8-0d6f-49a2-a63c-0cd42fb37521', '5836877f-bc83-4b58-aa0e-13f5d84d1773', 'dbd4a7c0-6fa2-4210-8e88-9abfe58ae2f1'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:48 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:48 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:48 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3" returned: 0 in 0.905s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:48 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3 Jul 23 03:22:48 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:48 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.459s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:48 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:48 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Deleted volume successfully. Jul 23 03:22:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c248196c-9d6d-4292-84b1-41df2e2b2ac1 tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-50937964-8849-4574-bbd3-10816f317e25-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:49 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-81c93e8b-b578-420d-b2a3-0a6e26e634e3" returned: 0 in 0.635s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-quobyte-81c93e8b-b578-420d-b2a3-0a6e26e634e3" released by "delete_volume" :: held 1.603s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Created reservations ['83caf973-42cc-4301-bb1d-5a15816bef82', '41344585-496e-44aa-9a98-09a09e51d4e5', '482a1756-ccc9-4b60-85cc-2028b6a4f472', '667cd700-ebb3-4fc4-8a02-6655741e095a'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:49 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:49 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "cinder-e3d12f06-6de5-4095-a47a-55f9057b5f69-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-e3d12f06-6de5-4095-a47a-55f9057b5f69-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "cinder-quobyte-e3d12f06-6de5-4095-a47a-55f9057b5f69" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-quobyte-e3d12f06-6de5-4095-a47a-55f9057b5f69" acquired by "delete_volume" :: waited 0.056s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[89755f2f-3337-4862-9678-8b48ba352388]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "cinder-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:50 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.809s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:50 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:50 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Deleted volume successfully. Jul 23 03:22:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-85035c3c-e986-46da-a5b4-99cd7902f124 tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-81c93e8b-b578-420d-b2a3-0a6e26e634e3-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "cinder-quobyte-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-quobyte-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0" acquired by "delete_volume" :: waited 0.031s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:50 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a59921-fd15-489f-ba89-9a179b1446ae]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:50 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69 Jul 23 03:22:50 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:50 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0 Jul 23 03:22:50 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:51 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69" returned: 0 in 1.119s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:51 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69 Jul 23 03:22:51 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:51 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0" returned: 0 in 1.154s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:51 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0 Jul 23 03:22:51 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:52 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e3d12f06-6de5-4095-a47a-55f9057b5f69" returned: 0 in 0.933s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-quobyte-e3d12f06-6de5-4095-a47a-55f9057b5f69" released by "delete_volume" :: held 2.193s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Created reservations ['6e0b428e-e81e-467a-9545-916934eaf9b2', '17a4a0d9-5503-42bd-89a9-9baa575770fe', 'd7f80ff8-73ff-496c-b404-946f53a35a33', 'ba8ab932-2ee0-4aca-afc3-a8cc53d53d93'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:52 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:52 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:52 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0" returned: 0 in 0.942s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-quobyte-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0" released by "delete_volume" :: held 2.200s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Created reservations ['9d50cbd7-cf54-47e8-a2d4-721a7a68695a', '9d1a423b-e2ca-4f80-9ec0-88b1589f8a64', '89e55d21-86ca-44ea-ab0a-78c797196052', 'ea7c95fb-0d5d-4ae5-be6a-8bb853dbb51f'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:52 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:52 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:52 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.592s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:52 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:52 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Deleted volume successfully. Jul 23 03:22:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4aa83673-9385-43ad-bf70-d229b4f5ba3a tempest-AttachVolumeNegativeTest-985906857 None] Lock "cinder-e3d12f06-6de5-4095-a47a-55f9057b5f69-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:53 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07" returned: 0 in 5.995s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:53 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cc6152-121e-4f48-9518-7bca00b22a07]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:53 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.485s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:53 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:53 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Deleted volume successfully. Jul 23 03:22:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-327a27cc-5f4f-424a-855e-f8c99289519e tempest-VolumesListAdminTestJSON-2043786691 None] Lock "cinder-6a06438a-9bf3-4f36-9a19-3e15a0ea29c0-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:53 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 Jul 23 03:22:53 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:53 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4" returned: 0 in 0.667s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:53 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07 {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:22:53 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Converted 1024.00 MB image at 170.79 MB/s Jul 23 03:22:53 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:22:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:53 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07 Jul 23 03:22:53 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:54 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07" returned: 0 in 0.256s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:54 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-0366fec5-5170-4681-b436-2bb9ceaaca07" released by "_copy_volume_from_snapshot" :: held 8.463s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:54 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-e019f8b5-7aae-4de0-b914-c5cd89ab0f5f-0366fec5-5170-4681-b436-2bb9ceaaca07" released by "_create_volume_from_snapshot" :: held 8.519s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.539s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:54 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d4948014-1468-4873-acc7-5456827b9fae tempest-GroupSnapshotsTest-2072320542 None] Create group from source-snapshot-12f9626b-ca9e-43c7-a2d4-160995f71f24 completed successfully. Jul 23 03:22:54 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-0366fec5-5170-4681-b436-2bb9ceaaca07" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:54 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-0366fec5-5170-4681-b436-2bb9ceaaca07" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:54 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ea010c-972a-49e4-83f0-ecb417213c00]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:55 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07 Jul 23 03:22:55 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:55 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07" returned: 0 in 0.428s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:55 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07 Jul 23 03:22:55 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:55 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0366fec5-5170-4681-b436-2bb9ceaaca07" returned: 0 in 0.260s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-0366fec5-5170-4681-b436-2bb9ceaaca07" released by "delete_volume" :: held 0.739s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['b5592bd7-84d9-4f94-883f-65211975f366'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:55 devstack cinder-volume[88392]: WARNING cinder.quota [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-686777143 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-686777143, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:22:55 devstack cinder-volume[88392]: WARNING cinder.quota [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-686777143 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-686777143, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['fdb4dffb-4569-4b59-938a-475d224bf918', '339b061a-62cb-4dd6-8507-71b1d381c879', '123b042b-5657-407c-9fad-49e89a14eb73', '4654d4bb-5135-469c-b2ca-d5154cba5e6a'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:22:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:55 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:22:55 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:56 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.324s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:22:56 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-af136fad-aeb9-456b-8e83-09654abee967 tempest-GroupSnapshotsTest-2072320542 None] Delete group completed successfully. Jul 23 03:22:56 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] group_snapshot 12f9626b-ca9e-43c7-a2d4-160995f71f24: deleting Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] group_snapshot 12f9626b-ca9e-43c7-a2d4-160995f71f24: deleting {{(pid=88392) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-5212a8d0-62c7-490b-a2c9-278179ab28e4" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-5212a8d0-62c7-490b-a2c9-278179ab28e4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-e019f8b5-7aae-4de0-b914-c5cd89ab0f5f" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-e019f8b5-7aae-4de0-b914-c5cd89ab0f5f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Deleting offline snapshot e019f8b5-7aae-4de0-b914-c5cd89ab0f5f of volume 5212a8d0-62c7-490b-a2c9-278179ab28e4 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] snapshot_file for this snap is: volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[617e98fe-3ab9-4b08-b1c5-5977645c133f]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:56 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f Jul 23 03:22:56 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:56 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f" returned: 0 in 0.492s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5212a8d0-62c7-490b-a2c9-278179ab28e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[008a6d73-482d-49b5-8586-6d7c91aa6fd5]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:57 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 Jul 23 03:22:57 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:57 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4" returned: 0 in 0.547s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:57 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f Jul 23 03:22:57 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:57 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f" returned: 0 in 0.418s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:57 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f Jul 23 03:22:57 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:58 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4.e019f8b5-7aae-4de0-b914-c5cd89ab0f5f" returned: 0 in 0.330s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:58 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-e019f8b5-7aae-4de0-b914-c5cd89ab0f5f" released by "_delete_snapshot" :: held 1.927s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:58 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-5212a8d0-62c7-490b-a2c9-278179ab28e4" released by "delete_snapshot" :: held 1.967s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:22:58 devstack cinder-volume[88392]: WARNING cinder.quota [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-686777143 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-686777143, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:22:58 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['23802b5f-e02f-4166-a904-d067ba22fa3c', 'fd11581e-1a60-48ad-aaa8-4507a8d74127', 'ad246a1c-efe2-42f3-91d9-e398d058f8d9', 'd755d71d-3613-4f63-b241-44bd8b65a175'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:22:58 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ce14b3e6-09ce-47f1-a04f-14df68b2a64a tempest-GroupSnapshotsTest-2072320542 None] group_snapshot 12f9626b-ca9e-43c7-a2d4-160995f71f24: deleted successfully Jul 23 03:22:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-5212a8d0-62c7-490b-a2c9-278179ab28e4" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:22:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-5212a8d0-62c7-490b-a2c9-278179ab28e4" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:22:59 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca0d91a-36e0-407f-a038-c647eb1b0d39]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:22:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:59 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 Jul 23 03:22:59 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:59 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4" returned: 0 in 0.468s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:22:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:22:59 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4 Jul 23 03:22:59 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:22:59 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jul 23 03:22:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5212a8d0-62c7-490b-a2c9-278179ab28e4" returned: 0 in 0.322s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:00 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-5212a8d0-62c7-490b-a2c9-278179ab28e4" released by "delete_volume" :: held 0.899s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:00 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['2eb1b591-227f-4ccb-8933-7fc28f08e865'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:00 devstack cinder-volume[88392]: WARNING cinder.db.api [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-686777143'] Jul 23 03:23:00 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['4951569f-3cde-45fc-87c3-da9ad715bcb1', 'e20ac87d-c5da-48f4-b35a-69dbea994535', '06aa49c0-087c-491c-b83e-b48734c1b679', '1f9e3b6b-3a5d-4fd1-a809-050f75d0ea52'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:00 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:00 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:00 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:23:00 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:00 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.259s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:00 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:00 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c55a44ab-51a3-43c6-bcaa-6d8e73b46f25 tempest-GroupSnapshotsTest-2072320542 None] Delete group completed successfully. Jul 23 03:23:01 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-764ffce5-f07a-40f3-8357-3f3d947bb154 tempest-GroupSnapshotsTest-2072320542 None] Group tempest-GroupSnapshotsTest-Group-362606225: creating Jul 23 03:23:01 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-764ffce5-f07a-40f3-8357-3f3d947bb154 tempest-GroupSnapshotsTest-2072320542 None] Group tempest-GroupSnapshotsTest-Group-362606225: created successfully Jul 23 03:23:01 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-764ffce5-f07a-40f3-8357-3f3d947bb154 tempest-GroupSnapshotsTest-2072320542 None] Create group completed successfully. Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Flow 'volume_create_manager' (d509f237-9693-44bf-bb10-4d589eaf8b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb333e7-8fc7-48e4-87c4-64788f4cbbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-35521588-a7f5-4dee-b693-890c40a2786b tempest-BackendsCapabilitiesAdminTestsJSON-1034337987 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88392) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb333e7-8fc7-48e4-87c4-64788f4cbbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1791307249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c326674c-714d-4c46-bc9e-564ab3ec61a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90aa6076c8a24009ac81fa2f855b2354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:03Z,use_quota=True,user_id='61201e3b269248ffa2831d31f0302323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682b7b95-7ee0-48f9-ae61-6f90601ff697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682b7b95-7ee0-48f9-ae61-6f90601ff697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb66316-3752-4006-bc6f-edd242079d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.image.glance [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Creating Keystone auth plugin from conf {{(pid=88392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-492dd535-8e87-47a9-a490-3ed725be3677 tempest-BackendsCapabilitiesAdminTestsJSON-1034337987 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88392) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Flow 'volume_create_manager' (c3b33893-ba1c-4ae9-856e-09974011d40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5624ce6c-0745-46e1-a24c-8b0e6f7efa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5624ce6c-0745-46e1-a24c-8b0e6f7efa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1787425637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56dcd0c9-5be8-4fc5-8cc8-8775372fad66,host='devstack@QuobyteHD#QuobyteHD',id=01b49a17-848b-4b81-a77b-18e8320a8cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4750d23d031e4c6a827c68ded1f9eca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:04Z,use_quota=True,user_id='3bb301e739e548e0a2e70d5680340abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0870e612-c5a5-4fb5-81fc-45f85dd5b481),volume_type_id=0870e612-c5a5-4fb5-81fc-45f85dd5b481)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55c5fd6-3840-4b1a-b4dd-d596ced0e01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55c5fd6-3840-4b1a-b4dd-d596ced0e01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d4f4cb-09b4-447a-817e-b02ffdddf64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d4f4cb-09b4-447a-817e-b02ffdddf64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b49a17-848b-4b81-a77b-18e8320a8cab', 'volume_name': 'volume-01b49a17-848b-4b81-a77b-18e8320a8cab', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6474ac1d-024c-4cc7-bbb5-5b0f5f3e4650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6474ac1d-024c-4cc7-bbb5-5b0f5f3e4650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00b13a3-9f1b-40ff-9a6d-dadc05a955c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:04 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Volume 01b49a17-848b-4b81-a77b-18e8320a8cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b49a17-848b-4b81-a77b-18e8320a8cab', 'volume_size': 1} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56dcd0c9-5be8-4fc5-8cc8-8775372fad66,created_at=2026-07-23T01:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1787425637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56dcd0c9-5be8-4fc5-8cc8-8775372fad66,host='devstack@QuobyteHD#QuobyteHD',id=01b49a17-848b-4b81-a77b-18e8320a8cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4750d23d031e4c6a827c68ded1f9eca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:04Z,use_quota=True,user_id='3bb301e739e548e0a2e70d5680340abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0870e612-c5a5-4fb5-81fc-45f85dd5b481),volume_type_id=0870e612-c5a5-4fb5-81fc-45f85dd5b481)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Creating volume 01b49a17-848b-4b81-a77b-18e8320a8cab {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:04 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:04 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab 1073741824 Jul 23 03:23:04 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:04 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab 1073741824" returned: 0 in 0.578s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:04 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab Jul 23 03:23:04 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb66316-3752-4006-bc6f-edd242079d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c326674c-714d-4c46-bc9e-564ab3ec61a0', 'volume_name': 'volume-c326674c-714d-4c46-bc9e-564ab3ec61a0', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85aef555-1389-4030-8f9a-61fe363e4f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85aef555-1389-4030-8f9a-61fe363e4f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e72549-d805-45a8-a7d6-7cb8722e846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:04 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Volume c326674c-714d-4c46-bc9e-564ab3ec61a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c326674c-714d-4c46-bc9e-564ab3ec61a0', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:23:04 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Trying to clone c326674c-714d-4c46-bc9e-564ab3ec61a0 from image 2d810839-198a-4642-93d6-ed27296a0802 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]). {{(pid=88392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:23:05 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab" returned: 0 in 0.389s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00b13a3-9f1b-40ff-9a6d-dadc05a955c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b49a17-848b-4b81-a77b-18e8320a8cab', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdede218-5280-428f-a2d7-0ba7f1f07d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:05 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Volume volume-01b49a17-848b-4b81-a77b-18e8320a8cab (01b49a17-848b-4b81-a77b-18e8320a8cab): created successfully Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdede218-5280-428f-a2d7-0ba7f1f07d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Flow 'volume_create_manager' (c3b33893-ba1c-4ae9-856e-09974011d40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:05 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e6271faa-4f53-43ad-b4c6-a87395e03ef4 tempest-GroupSnapshotsTest-2072320542 None] Created volume successfully. Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:23:05 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Image download 20.69 MB at 20.69 MB/s Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff9a47c-376d-43e2-b091-3caebf5713ac]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:05 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD Jul 23 03:23:05 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:05 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Temporary image 2d810839-198a-4642-93d6-ed27296a0802 is fetched for user 61201e3b269248ffa2831d31f0302323. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc65d371-4778-4593-9b1b-48481123619a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:05 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD Jul 23 03:23:05 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:06 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1791307249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c326674c-714d-4c46-bc9e-564ab3ec61a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90aa6076c8a24009ac81fa2f855b2354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:03Z,use_quota=True,user_id='61201e3b269248ffa2831d31f0302323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Creating volume c326674c-714d-4c46-bc9e-564ab3ec61a0 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:06 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:06 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 1073741824 Jul 23 03:23:06 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:06 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 1073741824" returned: 0 in 0.596s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:06 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 Jul 23 03:23:06 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:06 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:23:06 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Flow 'volume_create_manager' (301e5edf-5893-4df0-b9ac-368ac8905bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295ccfdc-8a4a-4204-b345-2436dc1b5723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295ccfdc-8a4a-4204-b345-2436dc1b5723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-67157642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56dcd0c9-5be8-4fc5-8cc8-8775372fad66,host='devstack@QuobyteHD#QuobyteHD',id=11611d5d-d2d7-40a4-b615-a8d44e2041b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4750d23d031e4c6a827c68ded1f9eca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:07Z,use_quota=True,user_id='3bb301e739e548e0a2e70d5680340abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0870e612-c5a5-4fb5-81fc-45f85dd5b481),volume_type_id=0870e612-c5a5-4fb5-81fc-45f85dd5b481)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c93571-3c56-4700-9b63-81f0bd495bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c93571-3c56-4700-9b63-81f0bd495bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986d67bd-718b-41e0-beed-6b7b8144688e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986d67bd-718b-41e0-beed-6b7b8144688e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11611d5d-d2d7-40a4-b615-a8d44e2041b8', 'volume_name': 'volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a62029b-af68-4297-ac0a-f270130e3dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a62029b-af68-4297-ac0a-f270130e3dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e522c4-8fa3-4ec8-923d-ecb211bee9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:07 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Volume 11611d5d-d2d7-40a4-b615-a8d44e2041b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8', 'volume_size': 1} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:07 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0" returned: 0 in 0.382s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56dcd0c9-5be8-4fc5-8cc8-8775372fad66,created_at=2026-07-23T01:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-67157642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56dcd0c9-5be8-4fc5-8cc8-8775372fad66,host='devstack@QuobyteHD#QuobyteHD',id=11611d5d-d2d7-40a4-b615-a8d44e2041b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4750d23d031e4c6a827c68ded1f9eca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:07Z,use_quota=True,user_id='3bb301e739e548e0a2e70d5680340abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0870e612-c5a5-4fb5-81fc-45f85dd5b481),volume_type_id=0870e612-c5a5-4fb5-81fc-45f85dd5b481)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Creating volume 11611d5d-d2d7-40a4-b615-a8d44e2041b8 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:07 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:07 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.437s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:23:07 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 1073741824 Jul 23 03:23:07 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Attempting download of 2d810839-198a-4642-93d6-ed27296a0802 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}])) to volume c326674c-714d-4c46-bc9e-564ab3ec61a0. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd60b4e7-0ab6-4b8d-aa9b-2061aef445a8]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_5k0_5ya7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:07 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_5k0_5ya7 Jul 23 03:23:07 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:07 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_5k0_5ya7" returned: 0 in 0.506s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_5k0_5ya7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:08 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 1073741824" returned: 0 in 0.772s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:08 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_5k0_5ya7 Jul 23 03:23:08 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:08 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 Jul 23 03:23:08 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:08 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_5k0_5ya7" returned: 1 in 0.451s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_5k0_5ya7' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7b776f-4550-4146-aa82-fcbf2298dca3]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:08 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8" returned: 0 in 0.301s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e522c4-8fa3-4ec8-923d-ecb211bee9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e863114-06b5-4490-a9c9-e11c613bee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:08 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Volume volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 (11611d5d-d2d7-40a4-b615-a8d44e2041b8): created successfully Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e863114-06b5-4490-a9c9-e11c613bee79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Flow 'volume_create_manager' (301e5edf-5893-4df0-b9ac-368ac8905bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:08 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b1f6794a-041b-4575-a0b5-0a5c5db05d6e tempest-GroupSnapshotsTest-2072320542 None] Created volume successfully. Jul 23 03:23:08 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD Jul 23 03:23:08 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:08 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] 2d810839-198a-4642-93d6-ed27296a0802 was qcow2, converting to qcow2 {{(pid=88392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:23:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:08 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 Jul 23 03:23:08 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:09 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-04d6923f-ae43-4b92-b53f-989cf67ef6aa tempest-GroupSnapshotsTest-2072320542 None] Update group completed successfully. Jul 23 03:23:10 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-16e4dc43-0add-4841-bd03-b9de697cecf7 tempest-GroupSnapshotsV319Test-101133003 None] Group tempest-GroupSnapshotsV319Test-Group-553462899: creating Jul 23 03:23:10 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-16e4dc43-0add-4841-bd03-b9de697cecf7 tempest-GroupSnapshotsV319Test-101133003 None] Group tempest-GroupSnapshotsV319Test-Group-553462899: created successfully Jul 23 03:23:10 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-16e4dc43-0add-4841-bd03-b9de697cecf7 tempest-GroupSnapshotsV319Test-101133003 None] Create group completed successfully. Jul 23 03:23:10 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0" returned: 0 in 2.094s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:10 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_8zfr32zbdevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:23:10 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Converted 112.00 MB image at 53.46 MB/s Jul 23 03:23:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:10 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 1G Jul 23 03:23:10 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1585c2c4-4db5-4be6-b2da-95cdc60eba06 tempest-GroupSnapshotsTest-2072320542 None] Update group completed successfully. Jul 23 03:23:11 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 1G" returned: 0 in 0.424s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Downloaded image 2d810839-198a-4642-93d6-ed27296a0802 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}])) to volume c326674c-714d-4c46-bc9e-564ab3ec61a0 successfully. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Temporary image 2d810839-198a-4642-93d6-ed27296a0802 for user 61201e3b269248ffa2831d31f0302323 is deleted. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Marking volume c326674c-714d-4c46-bc9e-564ab3ec61a0 as bootable. {{(pid=88392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Copying metadata from image 2d810839-198a-4642-93d6-ed27296a0802 to c326674c-714d-4c46-bc9e-564ab3ec61a0. {{(pid=88392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Creating volume glance metadata for volume c326674c-714d-4c46-bc9e-564ab3ec61a0 backed by image 2d810839-198a-4642-93d6-ed27296a0802 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e72549-d805-45a8-a7d6-7cb8722e846b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c326674c-714d-4c46-bc9e-564ab3ec61a0', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d35caee-d9f0-4200-ae14-33d5238d4c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:11 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Volume volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 (c326674c-714d-4c46-bc9e-564ab3ec61a0): created successfully Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d35caee-d9f0-4200-ae14-33d5238d4c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Flow 'volume_create_manager' (d509f237-9693-44bf-bb10-4d589eaf8b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f4fb526a-e579-4227-bb1d-3a72c00afa37 tempest-VolumesImageMetadata-655019996 None] Created volume successfully. Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Flow 'volume_create_manager' (056d83bc-ba42-4ab7-bd32-9a1c3cec1e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de0bd38-f7a3-4e72-8c05-3cb0781b2d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de0bd38-f7a3-4e72-8c05-3cb0781b2d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1199944889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82702973-616b-400e-800a-f589bd243e43,host='devstack@QuobyteHD#QuobyteHD',id=d95bd40e-dbd0-4080-9e81-670a60ee48ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b44a10b1c14c3d87e7932c0ac880e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:12Z,use_quota=True,user_id='f3f02a05889f499dbe16dcdf81b21200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6d30225-6ce6-41d7-bb9a-c87e9a701bb2),volume_type_id=a6d30225-6ce6-41d7-bb9a-c87e9a701bb2)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1bd8ee-01c8-4801-a357-8b468cd1ce3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1bd8ee-01c8-4801-a357-8b468cd1ce3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b544a3d-4736-41a0-a395-96a4c3bfcf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b544a3d-4736-41a0-a395-96a4c3bfcf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd95bd40e-dbd0-4080-9e81-670a60ee48ab', 'volume_name': 'volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725d51ef-3a78-4bdf-8f89-63aa2fccc187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725d51ef-3a78-4bdf-8f89-63aa2fccc187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44ee516-d60c-43ca-bb5f-ae1b9d117092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:11 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Volume d95bd40e-dbd0-4080-9e81-670a60ee48ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab', 'volume_size': 1} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=82702973-616b-400e-800a-f589bd243e43,created_at=2026-07-23T01:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1199944889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82702973-616b-400e-800a-f589bd243e43,host='devstack@QuobyteHD#QuobyteHD',id=d95bd40e-dbd0-4080-9e81-670a60ee48ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b44a10b1c14c3d87e7932c0ac880e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:12Z,use_quota=True,user_id='f3f02a05889f499dbe16dcdf81b21200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6d30225-6ce6-41d7-bb9a-c87e9a701bb2),volume_type_id=a6d30225-6ce6-41d7-bb9a-c87e9a701bb2)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Creating volume d95bd40e-dbd0-4080-9e81-670a60ee48ab {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:11 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:23:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:11 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab 1073741824 Jul 23 03:23:11 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Acquiring lock "cinder-c326674c-714d-4c46-bc9e-564ab3ec61a0-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:12 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c0c5ab96-7090-482e-a19a-7f3a21710e1f tempest-GroupSnapshotsTest-2072320542 None] Update group completed successfully. Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Lock "cinder-c326674c-714d-4c46-bc9e-564ab3ec61a0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:12 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Acquiring lock "cinder-quobyte-c326674c-714d-4c46-bc9e-564ab3ec61a0" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab 1073741824" returned: 0 in 0.614s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Lock "cinder-quobyte-c326674c-714d-4c46-bc9e-564ab3ec61a0" acquired by "delete_volume" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[587062da-52ed-49cf-b96f-bbc7ca9b2ada]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:12 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab Jul 23 03:23:12 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:12 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 Jul 23 03:23:12 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:12 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab" returned: 0 in 0.268s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44ee516-d60c-43ca-bb5f-ae1b9d117092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e238f1-a57a-4eda-9e6f-573a3b5cf05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:12 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Volume volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab (d95bd40e-dbd0-4080-9e81-670a60ee48ab): created successfully Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e238f1-a57a-4eda-9e6f-573a3b5cf05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Flow 'volume_create_manager' (056d83bc-ba42-4ab7-bd32-9a1c3cec1e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:12 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-61a858fe-82c8-4e5c-9f9b-9b8a21706acc tempest-GroupSnapshotsV319Test-101133003 None] Created volume successfully. Jul 23 03:23:12 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0" returned: 0 in 0.408s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:12 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0 Jul 23 03:23:12 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:13 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c326674c-714d-4c46-bc9e-564ab3ec61a0" returned: 0 in 0.239s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Lock "cinder-quobyte-c326674c-714d-4c46-bc9e-564ab3ec61a0" released by "delete_volume" :: held 0.688s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Created reservations ['36ddf48a-776f-44ae-b2f3-183a8c6fa8c3', 'aec66848-db90-4764-920c-f74fd112d9f1', '4acb58c8-5502-436d-9c3d-72da394c0924', '837793e3-dcd3-4c0a-bcef-fa43c22e440d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:13 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:23:13 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:13 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.274s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Deleted volume successfully. Jul 23 03:23:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-002a0aca-5d6a-4b51-b602-c72a2413cdeb tempest-VolumesImageMetadata-655019996 None] Lock "cinder-c326674c-714d-4c46-bc9e-564ab3ec61a0-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1c39f9b2-c02e-4e34-9ebe-74649d121a24 tempest-GroupSnapshotsTest-2072320542 None] Update group completed successfully. Jul 23 03:23:14 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] GroupSnapshot 8187c308-b67b-48fa-a2c3-3b48a5c0cdbb: creating. Jul 23 03:23:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] Group snapshot 8187c308-b67b-48fa-a2c3-3b48a5c0cdbb: creating. {{(pid=88392) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:23:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] Creating offline snapshot 08d874cc-dbed-401e-a57b-4782eb610bee of volume d95bd40e-dbd0-4080-9e81-670a60ee48ab {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:23:14 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[104af29b-5910-47db-9d55-4629aa327f9e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:14 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab Jul 23 03:23:14 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:15 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab" returned: 0 in 0.652s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] GroupSnapshot 33677286-7e05-4fe1-bb9a-6a6dec7e3ec4: creating. Jul 23 03:23:15 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee 1G Jul 23 03:23:15 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Group snapshot 33677286-7e05-4fe1-bb9a-6a6dec7e3ec4: creating. {{(pid=88392) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:23:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:16 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee 1G" returned: 0 in 0.584s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:16 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee Jul 23 03:23:16 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:16 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee" returned: 0 in 0.344s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:16 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:23:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:16 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee Jul 23 03:23:16 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:16 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee" returned: 0 in 0.306s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:16 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.info Jul 23 03:23:16 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:16 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.info" returned: 0 in 0.286s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:16 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:23:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:17 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.info Jul 23 03:23:17 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:17 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.info" returned: 0 in 0.277s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.758s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Creating offline snapshot 24b3a766-30d9-4081-86f2-a07289996e65 of volume 01b49a17-848b-4b81-a77b-18e8320a8cab {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Flow 'volume_create_manager' (8ccbab7c-0fea-43fe-a942-60bfe24cfb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4fc125-d2a3-4573-ba19-d7276a34742c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff69419f-82c6-4a33-92e3-2a61c40089e0]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4fc125-d2a3-4573-ba19-d7276a34742c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-816438716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8645fed8-4127-4d9a-900c-8b8c95104f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625a31faedf14304a2fcf1380e3f4ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:17Z,use_quota=True,user_id='88b03dd327654e829d1a7732c0574c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3f0435-85a2-4887-94cf-a5af48175185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3f0435-85a2-4887-94cf-a5af48175185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371d4d52-1ce6-498d-9dc7-62a3d3a57b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371d4d52-1ce6-498d-9dc7-62a3d3a57b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8645fed8-4127-4d9a-900c-8b8c95104f95', 'volume_name': 'volume-8645fed8-4127-4d9a-900c-8b8c95104f95', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094259a6-39a9-4883-813d-2783cd0612ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094259a6-39a9-4883-813d-2783cd0612ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5655f9b9-ed5f-4fcf-a35b-b03f29cfaac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:17 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Volume 8645fed8-4127-4d9a-900c-8b8c95104f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8645fed8-4127-4d9a-900c-8b8c95104f95', 'volume_size': 1} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:17 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8b49d75a-c7c9-4dce-81da-18203c4c364c tempest-GroupSnapshotsV319Test-101133003 None] group_snapshot 8187c308-b67b-48fa-a2c3-3b48a5c0cdbb: created successfully Jul 23 03:23:17 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab Jul 23 03:23:17 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:17 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab" returned: 0 in 0.375s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:17 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 1G Jul 23 03:23:17 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:18 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 1G" returned: 0 in 0.527s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b49a17-848b-4b81-a77b-18e8320a8cab -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:18 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b49a17-848b-4b81-a77b-18e8320a8cab -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 Jul 23 03:23:18 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:18 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] group_snapshot 8187c308-b67b-48fa-a2c3-3b48a5c0cdbb: deleting Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=173,cinder:INSERT=45,cinder:UPDATE=184,cinder:DELETE=15 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=152,cinder:INSERT=49,cinder:UPDATE=187,cinder:DELETE=11 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] group_snapshot 8187c308-b67b-48fa-a2c3-3b48a5c0cdbb: deleting {{(pid=88392) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Acquiring lock "cinder-quobyte-d95bd40e-dbd0-4080-9e81-670a60ee48ab" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Lock "cinder-quobyte-d95bd40e-dbd0-4080-9e81-670a60ee48ab" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Acquiring lock "cinder-quobyte-08d874cc-dbed-401e-a57b-4782eb610bee" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Lock "cinder-quobyte-08d874cc-dbed-401e-a57b-4782eb610bee" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Deleting offline snapshot 08d874cc-dbed-401e-a57b-4782eb610bee of volume d95bd40e-dbd0-4080-9e81-670a60ee48ab {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] snapshot_file for this snap is: volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49afc92-7291-47b3-92c7-60b567babb0c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:18 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b49a17-848b-4b81-a77b-18e8320a8cab -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65" returned: 0 in 0.333s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:18 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:18 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 Jul 23 03:23:18 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:18 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee Jul 23 03:23:18 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:18 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65" returned: 0 in 0.288s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:18 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.info Jul 23 03:23:18 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:18 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee" returned: 0 in 0.406s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dd0b85-2dac-4ef6-aae7-084be2439209]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:19 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab Jul 23 03:23:19 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:19 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.info" returned: 0 in 0.280s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:19 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:19 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.info Jul 23 03:23:19 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:19 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab" returned: 0 in 0.413s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:19 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee Jul 23 03:23:19 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:19 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.info" returned: 0 in 0.273s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Creating offline snapshot 25dc7596-6931-406f-81e2-8195fa993d1d of volume 11611d5d-d2d7-40a4-b615-a8d44e2041b8 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc383b1f-319a-470d-bb32-e2a4934fa33e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:19 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 Jul 23 03:23:19 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:19 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee" returned: 0 in 0.404s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:19 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee Jul 23 03:23:19 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:20 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8" returned: 0 in 0.447s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:20 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d 1G Jul 23 03:23:20 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:20 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab.08d874cc-dbed-401e-a57b-4782eb610bee" returned: 0 in 0.274s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Lock "cinder-quobyte-08d874cc-dbed-401e-a57b-4782eb610bee" released by "_delete_snapshot" :: held 1.619s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Lock "cinder-quobyte-d95bd40e-dbd0-4080-9e81-670a60ee48ab" released by "delete_snapshot" :: held 1.651s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:20 devstack cinder-volume[88392]: WARNING cinder.quota [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-923632924 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-923632924, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:20 devstack cinder-volume[88392]: WARNING cinder.quota [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-923632924 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-923632924, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:20 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] Created reservations ['734f0b0e-a527-4cc8-9766-a6b44cf0f21b', '425607f6-9e37-489a-9a3d-0026444dff5d', '83d7498f-8141-4ff8-afb7-a70eed13d065', '3e7ee74f-d15d-4aa4-8e75-82db29ba678d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:20 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4771b536-6fb7-409a-9cf7-6a881503d9f0 tempest-GroupSnapshotsV319Test-101133003 None] group_snapshot 8187c308-b67b-48fa-a2c3-3b48a5c0cdbb: deleted successfully Jul 23 03:23:20 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d 1G" returned: 0 in 0.474s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:20 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d Jul 23 03:23:20 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:20 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d" returned: 0 in 0.319s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:20 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:23:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:20 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d Jul 23 03:23:20 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:21 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d" returned: 0 in 0.372s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Acquiring lock "cinder-quobyte-d95bd40e-dbd0-4080-9e81-670a60ee48ab" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Lock "cinder-quobyte-d95bd40e-dbd0-4080-9e81-670a60ee48ab" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:21 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.info Jul 23 03:23:21 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[54415bd0-ac5f-428c-aa34-4795d57f6292]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:21 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab Jul 23 03:23:21 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:21 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.info" returned: 0 in 0.380s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:21 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:21 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.info Jul 23 03:23:21 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:21 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab" returned: 0 in 0.513s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:21 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab Jul 23 03:23:21 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:21 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.info" returned: 0 in 0.319s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.532s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-816438716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8645fed8-4127-4d9a-900c-8b8c95104f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625a31faedf14304a2fcf1380e3f4ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:17Z,use_quota=True,user_id='88b03dd327654e829d1a7732c0574c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Creating volume 8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:21 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:23:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:22 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 1073741824 Jul 23 03:23:22 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:22 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-86a849fd-ca2c-4bcc-a69a-de8db627e18a tempest-GroupSnapshotsTest-2072320542 None] group_snapshot 33677286-7e05-4fe1-bb9a-6a6dec7e3ec4: created successfully Jul 23 03:23:22 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d95bd40e-dbd0-4080-9e81-670a60ee48ab" returned: 0 in 0.354s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Lock "cinder-quobyte-d95bd40e-dbd0-4080-9e81-670a60ee48ab" released by "delete_volume" :: held 0.944s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Created reservations ['adbf7172-d1fa-41cd-8d75-990b86d9a860'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:22 devstack cinder-volume[88392]: WARNING cinder.quota [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-923632924 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-923632924, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Created reservations ['8ef6e1fa-91f1-4343-be4c-9d4a4b90c9bd', 'd313644a-f9e8-4bb6-8dcc-4928b1677ab1', '1cd79942-1c38-41ae-a580-03d21d67df9f', 'd7fc4ffe-52df-4fa0-970e-babed0ec38a1'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:22 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:23:22 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:22 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 1073741824" returned: 0 in 0.643s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:22 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 Jul 23 03:23:22 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:22 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.365s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:22 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:22 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d227d7ae-a717-4680-8a87-a6eb745666ae tempest-GroupSnapshotsV319Test-101133003 None] Delete group completed successfully. Jul 23 03:23:23 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95" returned: 0 in 0.325s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5655f9b9-ed5f-4fcf-a35b-b03f29cfaac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8645fed8-4127-4d9a-900c-8b8c95104f95', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fb0771-82e1-4a95-b196-932ed62beb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:23 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Volume volume-8645fed8-4127-4d9a-900c-8b8c95104f95 (8645fed8-4127-4d9a-900c-8b8c95104f95): created successfully Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fb0771-82e1-4a95-b196-932ed62beb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Flow 'volume_create_manager' (8ccbab7c-0fea-43fe-a942-60bfe24cfb45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] group_snapshot 33677286-7e05-4fe1-bb9a-6a6dec7e3ec4: deleting Jul 23 03:23:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d8c53c3d-2d72-4dbe-85e1-1fab6a6ea256 tempest-VolumesDeleteCascade-1631690257 None] Created volume successfully. Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] group_snapshot 33677286-7e05-4fe1-bb9a-6a6dec7e3ec4: deleting {{(pid=88392) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-01b49a17-848b-4b81-a77b-18e8320a8cab" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-01b49a17-848b-4b81-a77b-18e8320a8cab" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-24b3a766-30d9-4081-86f2-a07289996e65" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-24b3a766-30d9-4081-86f2-a07289996e65" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Deleting offline snapshot 24b3a766-30d9-4081-86f2-a07289996e65 of volume 01b49a17-848b-4b81-a77b-18e8320a8cab {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] snapshot_file for this snap is: volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0077fe6-548b-4584-a584-fa62f3a006a0]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:23 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 Jul 23 03:23:23 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:23 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65" returned: 0 in 0.513s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b49a17-848b-4b81-a77b-18e8320a8cab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[753ff8f1-5dc0-4d81-a89e-7d98e72be3bf]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:23 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab Jul 23 03:23:23 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] Creating offline snapshot 22aec069-1174-4927-990c-435ec78a9a99 of volume 8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:23:24 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbaf86a-57cf-41f0-84c1-85da4219c590]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:24 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 Jul 23 03:23:24 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:24 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab" returned: 0 in 0.689s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:24 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 Jul 23 03:23:24 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:24 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95" returned: 0 in 0.733s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:24 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 1G Jul 23 03:23:24 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:25 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65" returned: 0 in 0.719s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:25 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65 Jul 23 03:23:25 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:25 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 1G" returned: 0 in 0.640s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8645fed8-4127-4d9a-900c-8b8c95104f95 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:25 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8645fed8-4127-4d9a-900c-8b8c95104f95 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 Jul 23 03:23:25 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:25 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab.24b3a766-30d9-4081-86f2-a07289996e65" returned: 0 in 0.438s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-24b3a766-30d9-4081-86f2-a07289996e65" released by "_delete_snapshot" :: held 2.491s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-01b49a17-848b-4b81-a77b-18e8320a8cab" released by "delete_snapshot" :: held 2.521s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-11611d5d-d2d7-40a4-b615-a8d44e2041b8" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-11611d5d-d2d7-40a4-b615-a8d44e2041b8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-25dc7596-6931-406f-81e2-8195fa993d1d" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-25dc7596-6931-406f-81e2-8195fa993d1d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Deleting offline snapshot 25dc7596-6931-406f-81e2-8195fa993d1d of volume 11611d5d-d2d7-40a4-b615-a8d44e2041b8 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] snapshot_file for this snap is: volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[145c976a-8f92-4746-838d-1beeaa95e08d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:25 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d Jul 23 03:23:25 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:25 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8645fed8-4127-4d9a-900c-8b8c95104f95 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99" returned: 0 in 0.377s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:25 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 is being set with open permissions: ugo+rw Jul 23 03:23:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:26 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 Jul 23 03:23:26 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:26 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99" returned: 0 in 0.301s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:26 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d" returned: 0 in 0.454s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:26 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca618fa8-2052-439d-914e-aaeca3196d79]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:26 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.info Jul 23 03:23:26 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:26 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 Jul 23 03:23:26 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:26 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.info" returned: 0 in 0.434s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:26 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.info is being set with open permissions: ugo+rw Jul 23 03:23:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:26 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.info Jul 23 03:23:26 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:26 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8" returned: 0 in 0.580s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:26 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d Jul 23 03:23:26 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:27 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.info" returned: 0 in 0.499s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.244s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:27 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-831f2d4e-c5a7-4943-86e1-ca9636c090a1 tempest-VolumesDeleteCascade-1631690257 None] Create snapshot completed successfully Jul 23 03:23:27 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d" returned: 0 in 0.558s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:27 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d Jul 23 03:23:27 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:27 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8.25dc7596-6931-406f-81e2-8195fa993d1d" returned: 0 in 0.280s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-25dc7596-6931-406f-81e2-8195fa993d1d" released by "_delete_snapshot" :: held 1.998s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-11611d5d-d2d7-40a4-b615-a8d44e2041b8" released by "delete_snapshot" :: held 2.024s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:27 devstack cinder-volume[88392]: WARNING cinder.quota [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1748251419 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1748251419, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:27 devstack cinder-volume[88392]: WARNING cinder.quota [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1748251419 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1748251419, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:27 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['a36caf2e-d78e-43ae-8dd3-4ea594807763', '319f49f8-ce21-4bc4-b04a-1a4a4ce83d12', 'ba78f130-ca41-4614-b111-62afb02d1e2b', '1a9caa82-4651-4a9b-acf8-2732bfbeaad4'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:28 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['aa856a9b-7433-42f8-8a82-426604912ef0', '43770d17-153c-4553-93fd-b402e5feb527', '41812da2-305f-4a92-99dc-9ba8e6f35e10', '77a101d1-c960-4a94-a90e-0d32dc59b9e7'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:28 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-bd5eab22-2e71-4cb5-b46a-26303396dc1b tempest-GroupSnapshotsTest-2072320542 None] group_snapshot 33677286-7e05-4fe1-bb9a-6a6dec7e3ec4: deleted successfully Jul 23 03:23:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] Creating offline snapshot 23c03701-0ee3-44a7-b024-7e2b3cd4ff66 of volume 8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:23:28 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a2383c-2bc0-43a9-8cc1-58e4a377f28e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:28 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 Jul 23 03:23:28 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:29 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99" returned: 0 in 0.772s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8645fed8-4127-4d9a-900c-8b8c95104f95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-01b49a17-848b-4b81-a77b-18e8320a8cab" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-01b49a17-848b-4b81-a77b-18e8320a8cab" acquired by "delete_volume" :: waited 0.038s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:29 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 1G Jul 23 03:23:29 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:29 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8e2417-75b1-458b-8838-1b3eccb4590a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:29 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab Jul 23 03:23:29 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:30 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 1G" returned: 0 in 0.808s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:30 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 Jul 23 03:23:30 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:30 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab" returned: 0 in 0.676s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:30 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab Jul 23 03:23:30 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:30 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-01b49a17-848b-4b81-a77b-18e8320a8cab" returned: 0 in 0.394s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-01b49a17-848b-4b81-a77b-18e8320a8cab" released by "delete_volume" :: held 1.240s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-11611d5d-d2d7-40a4-b615-a8d44e2041b8" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-11611d5d-d2d7-40a4-b615-a8d44e2041b8" acquired by "delete_volume" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:30 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66" returned: 0 in 0.600s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:30 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 is being set with open permissions: ugo+rw Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee2062-9f32-4924-a939-aac97d70ece1]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:30 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 Jul 23 03:23:30 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e8f442cd-d36d-45cf-881a-f1e83703cf3c tempest-GroupsV314Test-1419546433 None] Group tempest-GroupsV314Test-Group-325377564: creating Jul 23 03:23:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e8f442cd-d36d-45cf-881a-f1e83703cf3c tempest-GroupsV314Test-1419546433 None] Group tempest-GroupsV314Test-Group-325377564: created successfully Jul 23 03:23:31 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e8f442cd-d36d-45cf-881a-f1e83703cf3c tempest-GroupsV314Test-1419546433 None] Create group completed successfully. Jul 23 03:23:31 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 Jul 23 03:23:31 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:31 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66" returned: 0 in 0.413s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.752s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:31 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4e4d4b1d-b06d-417f-9e38-c0f2d3065480 tempest-VolumesDeleteCascade-1631690257 None] Create snapshot completed successfully Jul 23 03:23:31 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8" returned: 0 in 0.475s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:31 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8 Jul 23 03:23:31 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:31 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-11611d5d-d2d7-40a4-b615-a8d44e2041b8" returned: 0 in 0.256s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-11611d5d-d2d7-40a4-b615-a8d44e2041b8" released by "delete_volume" :: held 0.846s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['1f797df4-9c31-4a49-bdd1-5e3789aafa3f'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-8645fed8-4127-4d9a-900c-8b8c95104f95-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:31 devstack cinder-volume[88392]: WARNING cinder.quota [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1748251419 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1748251419, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-8645fed8-4127-4d9a-900c-8b8c95104f95-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['57fc7563-8824-4a9f-aded-461835269d91', '80dec768-3414-4655-a4d4-4e4c07657b32', '2a5bd0f8-eb61-4e7d-ae77-ffaa5848db01', '0867633c-7f29-4e67-8393-7cddff6a279f'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Performing cascade delete. {{(pid=88392) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-22aec069-1174-4927-990c-435ec78a9a99-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-22aec069-1174-4927-990c-435ec78a9a99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-quobyte-8645fed8-4127-4d9a-900c-8b8c95104f95" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-8645fed8-4127-4d9a-900c-8b8c95104f95" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-quobyte-22aec069-1174-4927-990c-435ec78a9a99" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-22aec069-1174-4927-990c-435ec78a9a99" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Deleting offline snapshot 22aec069-1174-4927-990c-435ec78a9a99 of volume 8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] snapshot_file for this snap is: volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ef8e99-b592-4d96-85a5-822fae696653]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['a91b4e53-5813-4d60-81c6-b3f31e51fcd1', 'fa915b30-13ab-4e0a-a5b7-e64246f7468d', '99d35e54-4623-464b-b674-41643423bf91', 'f3c7ec66-a6ae-4f1b-a020-dd394d2460c7'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:32 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 Jul 23 03:23:32 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:32 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:23:32 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:32 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99" returned: 0 in 0.470s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8645fed8-4127-4d9a-900c-8b8c95104f95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6491cdd-58d8-4f26-a029-2680151acd4a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:32 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Flow 'volume_create_manager' (1e589e0a-d29e-41e5-94e5-fa2675aa1d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b007ac-6b02-4906-b755-079b80f96621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:32 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.395s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:32 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:32 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-09704141-5dba-4589-b4c8-09473644df5a tempest-GroupSnapshotsTest-2072320542 None] Delete group completed successfully. Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b007ac-6b02-4906-b755-079b80f96621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1121969290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cd2b62e-dc8a-431b-bd3d-96146b6d6aca,host='devstack@QuobyteHD#QuobyteHD',id=8b04ef92-d61f-4039-8ab3-88532fe92d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff02f7d77db541389f896db3e80f6d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:33Z,use_quota=True,user_id='e6a92a75d77e41d0ba56fa245ec102a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f46fe8af-5512-4669-a088-726a708226c9),volume_type_id=f46fe8af-5512-4669-a088-726a708226c9)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce382713-1600-4c9d-a371-4d8b4ff16c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce382713-1600-4c9d-a371-4d8b4ff16c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273cbf38-2e12-4d57-9f68-bef40759eb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273cbf38-2e12-4d57-9f68-bef40759eb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b04ef92-d61f-4039-8ab3-88532fe92d31', 'volume_name': 'volume-8b04ef92-d61f-4039-8ab3-88532fe92d31', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01d2902-5397-41a2-90fe-53289da6519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01d2902-5397-41a2-90fe-53289da6519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caab865a-3df4-4fa0-b7b7-0eaee3b074ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:32 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Volume 8b04ef92-d61f-4039-8ab3-88532fe92d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b04ef92-d61f-4039-8ab3-88532fe92d31', 'volume_size': 1} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3cd2b62e-dc8a-431b-bd3d-96146b6d6aca,created_at=2026-07-23T01:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1121969290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cd2b62e-dc8a-431b-bd3d-96146b6d6aca,host='devstack@QuobyteHD#QuobyteHD',id=8b04ef92-d61f-4039-8ab3-88532fe92d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff02f7d77db541389f896db3e80f6d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:33Z,use_quota=True,user_id='e6a92a75d77e41d0ba56fa245ec102a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f46fe8af-5512-4669-a088-726a708226c9),volume_type_id=f46fe8af-5512-4669-a088-726a708226c9)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Creating volume 8b04ef92-d61f-4039-8ab3-88532fe92d31 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:32 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:23:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:32 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 1073741824 Jul 23 03:23:32 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:33 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95" returned: 0 in 0.466s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[24018c3f-71a6-4e90-b62c-4ce5252f7e1c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:33 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 Jul 23 03:23:33 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:33 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 1073741824" returned: 0 in 0.427s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:33 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 Jul 23 03:23:33 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:33 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66" returned: 0 in 0.413s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8645fed8-4127-4d9a-900c-8b8c95104f95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3851db2-6ab2-4227-91f0-9829f7658352]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:33 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31" returned: 0 in 0.347s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:33 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 Jul 23 03:23:33 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caab865a-3df4-4fa0-b7b7-0eaee3b074ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b04ef92-d61f-4039-8ab3-88532fe92d31', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfde54e6-130a-4429-8ea9-2fbf4194d7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:33 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Volume volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 (8b04ef92-d61f-4039-8ab3-88532fe92d31): created successfully Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfde54e6-130a-4429-8ea9-2fbf4194d7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Flow 'volume_create_manager' (1e589e0a-d29e-41e5-94e5-fa2675aa1d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:33 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1ac25ab9-a1f1-499e-80a9-da14a7c2b2c3 tempest-GroupsV314Test-1419546433 None] Created volume successfully. Jul 23 03:23:33 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c7310670-8267-4f72-8369-599a1084b16e tempest-GroupSnapshotsTest-2072320542 None] Group tempest-GroupSnapshotsTest-Group-1397735250: creating Jul 23 03:23:34 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c7310670-8267-4f72-8369-599a1084b16e tempest-GroupSnapshotsTest-2072320542 None] Group tempest-GroupSnapshotsTest-Group-1397735250: created successfully Jul 23 03:23:34 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c7310670-8267-4f72-8369-599a1084b16e tempest-GroupSnapshotsTest-2072320542 None] Create group completed successfully. Jul 23 03:23:34 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99" returned: 0 in 0.487s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8645fed8-4127-4d9a-900c-8b8c95104f95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b8ba73-7e28-4d4d-a200-c7e45f937c65]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:34 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 Jul 23 03:23:34 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:34 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95" returned: 0 in 0.396s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:34 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 Jul 23 03:23:34 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:34 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Cloning volume 8b04ef92-d61f-4039-8ab3-88532fe92d31 to volume 48a99812-a17b-405d-ac48-b1dc8b67eacf Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Creating offline snapshot 5cf301d4-6ed6-4986-911a-a20efd2bb130 of volume 8b04ef92-d61f-4039-8ab3-88532fe92d31 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c937d29-d4ee-43b3-90f5-f2bbd3776afb]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:34 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99" returned: 0 in 0.396s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:34 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99 Jul 23 03:23:34 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:34 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 Jul 23 03:23:34 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:35 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31" returned: 0 in 0.505s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:35 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 1G Jul 23 03:23:35 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:35 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.22aec069-1174-4927-990c-435ec78a9a99" returned: 0 in 0.483s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8645fed8-4127-4d9a-900c-8b8c95104f95 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 -F qcow2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:35 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8645fed8-4127-4d9a-900c-8b8c95104f95 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 -F qcow2 Jul 23 03:23:35 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:35 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8645fed8-4127-4d9a-900c-8b8c95104f95 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 -F qcow2" returned: 0 in 0.395s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-22aec069-1174-4927-990c-435ec78a9a99" released by "_delete_snapshot" :: held 3.717s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-8645fed8-4127-4d9a-900c-8b8c95104f95" released by "delete_snapshot" :: held 3.766s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:35 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 1G" returned: 0 in 0.559s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:35 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 Jul 23 03:23:35 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Flow 'volume_create_manager' (b6a75fdf-0797-4c41-af74-e3b54d8ac3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f95919-cbd0-4f01-bb99-f29d10564933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f95919-cbd0-4f01-bb99-f29d10564933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-690947448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b114588f-a1b7-4e23-bc19-fa98d2ec5a16,host='devstack@QuobyteHD#QuobyteHD',id=e40ade29-55f0-493a-9002-96e816de294c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4750d23d031e4c6a827c68ded1f9eca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:36Z,use_quota=True,user_id='3bb301e739e548e0a2e70d5680340abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ce23b03-8de7-4745-8846-779634a2e98f),volume_type_id=8ce23b03-8de7-4745-8846-779634a2e98f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53524197-b749-4112-9ac6-11fcd53f88b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53524197-b749-4112-9ac6-11fcd53f88b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f115ee-e491-4297-8e5a-494cf5e68047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f115ee-e491-4297-8e5a-494cf5e68047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e40ade29-55f0-493a-9002-96e816de294c', 'volume_name': 'volume-e40ade29-55f0-493a-9002-96e816de294c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501c5f7f-e821-4895-ab89-2c7ed5035d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501c5f7f-e821-4895-ab89-2c7ed5035d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66726331-6d42-4b62-a0d6-3acdcaae6ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:36 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Volume e40ade29-55f0-493a-9002-96e816de294c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e40ade29-55f0-493a-9002-96e816de294c', 'volume_size': 1} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Created reservations ['0ad77699-28f3-4b82-86c4-36ca4c86d00c', '435da6d8-344b-47f0-bb65-8c97ae442d6b', '9690524d-d963-4995-a2dc-279be3d457a6', 'ab50632b-1817-4d54-8bf7-0c79dc19ce83'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Delete snapshot completed successfully. Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-22aec069-1174-4927-990c-435ec78a9a99-delete_snapshot" released by "delete_snapshot" :: held 4.117s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-23c03701-0ee3-44a7-b024-7e2b3cd4ff66-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-23c03701-0ee3-44a7-b024-7e2b3cd4ff66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-quobyte-8645fed8-4127-4d9a-900c-8b8c95104f95" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-8645fed8-4127-4d9a-900c-8b8c95104f95" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-quobyte-23c03701-0ee3-44a7-b024-7e2b3cd4ff66" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-23c03701-0ee3-44a7-b024-7e2b3cd4ff66" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Deleting offline snapshot 23c03701-0ee3-44a7-b024-7e2b3cd4ff66 of volume 8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:23:36 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] snapshot_file for this snap is: volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130" returned: 0 in 0.371s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:36 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3638c5-dcc3-4084-9820-64b541bef580]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:36 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 Jul 23 03:23:36 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:36 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 Jul 23 03:23:36 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:36 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130" returned: 0 in 0.349s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:36 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66" returned: 0 in 0.384s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8645fed8-4127-4d9a-900c-8b8c95104f95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:36 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.info Jul 23 03:23:36 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fffeac-c4de-4f0e-a7b1-e170e26c924e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:36 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 Jul 23 03:23:36 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:36 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.info" returned: 0 in 0.265s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:36 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:23:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:36 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.info Jul 23 03:23:36 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:37 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95" returned: 0 in 0.388s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:37 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 Jul 23 03:23:37 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:37 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.info" returned: 0 in 0.276s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Acquiring lock "cinder-quobyte-48a99812-a17b-405d-ac48-b1dc8b67eacf" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Lock "cinder-quobyte-48a99812-a17b-405d-ac48-b1dc8b67eacf" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] snapshot: 5cf301d4-6ed6-4986-911a-a20efd2bb130, volume: 48a99812-a17b-405d-ac48-b1dc8b67eacf, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[832fe1b8-1ee7-42d6-9257-ff5104074ade]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:37 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 Jul 23 03:23:37 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:37 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66" returned: 0 in 0.375s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:37 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66 Jul 23 03:23:37 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:37 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130" returned: 0 in 0.428s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b04ef92-d61f-4039-8ab3-88532fe92d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[936f5091-2805-4f89-8898-4a62d8ad06b9]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:37 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95.23c03701-0ee3-44a7-b024-7e2b3cd4ff66" returned: 0 in 0.275s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-23c03701-0ee3-44a7-b024-7e2b3cd4ff66" released by "_delete_snapshot" :: held 1.540s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-8645fed8-4127-4d9a-900c-8b8c95104f95" released by "delete_snapshot" :: held 1.560s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:37 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 Jul 23 03:23:37 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Created reservations ['e5b00eab-c6a7-4bcb-aec0-2e78677a7741', 'c93707af-29f4-474f-a568-0cfbf2f0ae7c', '3b514960-501f-47b9-87b0-a4cba3350685', '48f7dacd-1c52-4ec5-839d-ef547d8b19a5'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:37 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Delete snapshot completed successfully. Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-23c03701-0ee3-44a7-b024-7e2b3cd4ff66-delete_snapshot" released by "delete_snapshot" :: held 1.739s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Snapshots deleted, issuing volume delete {{(pid=88392) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-quobyte-8645fed8-4127-4d9a-900c-8b8c95104f95" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-8645fed8-4127-4d9a-900c-8b8c95104f95" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7016b7c-6cae-487b-9b0e-c79b2f1ffaf6]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:38 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31" returned: 0 in 0.369s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:38 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:23:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:38 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 Jul 23 03:23:38 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:38 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf Jul 23 03:23:38 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:38 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95" returned: 0 in 0.406s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:38 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95 Jul 23 03:23:38 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:38 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8645fed8-4127-4d9a-900c-8b8c95104f95" returned: 0 in 0.309s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-8645fed8-4127-4d9a-900c-8b8c95104f95" released by "delete_volume" :: held 0.804s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:38 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Created reservations ['918660e8-706b-4994-927e-850e6d58428a', '212a967d-a4e1-4324-a848-675ac2365d47', '79f7f04b-0e8d-4fcf-ba0b-c37043f3b028', '6e67d6a1-862d-4977-a5c2-de4b812789aa'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:39 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:23:39 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:39 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.662s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:39 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Deleted volume successfully. Jul 23 03:23:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-46474b88-7cd9-4535-aa49-14de5108adde tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-8645fed8-4127-4d9a-900c-8b8c95104f95-delete_volume" released by "delete_volume" :: held 8.053s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:40 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Flow 'volume_create_manager' (ce45979a-49f9-4890-b9bb-910ad859e5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae61d772-a560-44df-8e31-2e1c24ac9088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae61d772-a560-44df-8e31-2e1c24ac9088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1509679918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48cd9ca-94bf-4506-952d-73936ef0a195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625a31faedf14304a2fcf1380e3f4ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:41Z,use_quota=True,user_id='88b03dd327654e829d1a7732c0574c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca942896-225f-452f-b729-f2b5d69d233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca942896-225f-452f-b729-f2b5d69d233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e851c16-b695-4509-a82c-012b8e37e3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e851c16-b695-4509-a82c-012b8e37e3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c48cd9ca-94bf-4506-952d-73936ef0a195', 'volume_name': 'volume-c48cd9ca-94bf-4506-952d-73936ef0a195', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063dfd19-e0f5-4b95-97f3-3d14f33984f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063dfd19-e0f5-4b95-97f3-3d14f33984f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99ea0bb-52ce-46f3-beab-8b3cb8e542b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:41 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Volume c48cd9ca-94bf-4506-952d-73936ef0a195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c48cd9ca-94bf-4506-952d-73936ef0a195', 'volume_size': 1} Jul 23 03:23:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:42 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf" returned: 0 in 4.881s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:42 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d24f15d-7a5a-4216-978c-68c893c1731c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:43 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 Jul 23 03:23:43 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:43 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31" returned: 0 in 0.476s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:43 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:23:43 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Converted 1024.00 MB image at 209.75 MB/s Jul 23 03:23:43 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:23:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:43 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf Jul 23 03:23:43 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:43 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf" returned: 0 in 0.237s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Lock "cinder-quobyte-48a99812-a17b-405d-ac48-b1dc8b67eacf" released by "_copy_volume_from_snapshot" :: held 6.468s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Acquiring lock "cinder-quobyte-5cf301d4-6ed6-4986-911a-a20efd2bb130" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Lock "cinder-quobyte-5cf301d4-6ed6-4986-911a-a20efd2bb130" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Deleting offline snapshot 5cf301d4-6ed6-4986-911a-a20efd2bb130 of volume 8b04ef92-d61f-4039-8ab3-88532fe92d31 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:23:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] snapshot_file for this snap is: volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:23:43 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[070dd8a2-ecc5-4261-aeec-26b12886623a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:43 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 Jul 23 03:23:43 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:44 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130" returned: 0 in 0.360s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b04ef92-d61f-4039-8ab3-88532fe92d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:44 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1615205e-60a3-4193-a840-7f70ae789d83]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:44 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 Jul 23 03:23:44 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:44 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31" returned: 0 in 0.341s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:44 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 Jul 23 03:23:44 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:44 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130" returned: 0 in 0.322s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:44 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130 Jul 23 03:23:44 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:44 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31.5cf301d4-6ed6-4986-911a-a20efd2bb130" returned: 0 in 0.233s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Lock "cinder-quobyte-5cf301d4-6ed6-4986-911a-a20efd2bb130" released by "_delete_snapshot" :: held 1.338s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.315s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b114588f-a1b7-4e23-bc19-fa98d2ec5a16,created_at=2026-07-23T01:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-690947448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b114588f-a1b7-4e23-bc19-fa98d2ec5a16,host='devstack@QuobyteHD#QuobyteHD',id=e40ade29-55f0-493a-9002-96e816de294c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4750d23d031e4c6a827c68ded1f9eca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:36Z,use_quota=True,user_id='3bb301e739e548e0a2e70d5680340abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ce23b03-8de7-4745-8846-779634a2e98f),volume_type_id=8ce23b03-8de7-4745-8846-779634a2e98f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Creating volume e40ade29-55f0-493a-9002-96e816de294c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:45 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:45 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c 1073741824 Jul 23 03:23:45 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5d6f35db-487b-40d4-9dc6-635c2753a9e9 tempest-GroupsV314Test-1419546433 None] Create group from source-group-3cd2b62e-dc8a-431b-bd3d-96146b6d6aca completed successfully. Jul 23 03:23:45 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c 1073741824" returned: 0 in 0.441s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:45 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c Jul 23 03:23:45 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Acquiring lock "cinder-quobyte-48a99812-a17b-405d-ac48-b1dc8b67eacf" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Lock "cinder-quobyte-48a99812-a17b-405d-ac48-b1dc8b67eacf" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d5752b-f9c2-4057-a9af-1a1882adddb2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:45 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c" returned: 0 in 0.251s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.751s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1509679918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48cd9ca-94bf-4506-952d-73936ef0a195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625a31faedf14304a2fcf1380e3f4ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:41Z,use_quota=True,user_id='88b03dd327654e829d1a7732c0574c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Creating volume c48cd9ca-94bf-4506-952d-73936ef0a195 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:45 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:45 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf Jul 23 03:23:45 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:45 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 1073741824 Jul 23 03:23:45 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66726331-6d42-4b62-a0d6-3acdcaae6ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e40ade29-55f0-493a-9002-96e816de294c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4c6af3-2dee-4b2a-986b-b216f14d3ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:45 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Volume volume-e40ade29-55f0-493a-9002-96e816de294c (e40ade29-55f0-493a-9002-96e816de294c): created successfully Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4c6af3-2dee-4b2a-986b-b216f14d3ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:45 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Flow 'volume_create_manager' (b6a75fdf-0797-4c41-af74-e3b54d8ac3d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-741fda30-aee0-44f0-bf1a-d4a1b102f9a0 tempest-GroupSnapshotsTest-2072320542 None] Created volume successfully. Jul 23 03:23:46 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf" returned: 0 in 0.379s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:46 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf Jul 23 03:23:46 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:46 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 1073741824" returned: 0 in 0.439s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:46 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 Jul 23 03:23:46 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:46 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-48a99812-a17b-405d-ac48-b1dc8b67eacf" returned: 0 in 0.246s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Lock "cinder-quobyte-48a99812-a17b-405d-ac48-b1dc8b67eacf" released by "delete_volume" :: held 0.671s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Created reservations ['6e9026de-ecd8-47f9-bb99-624506346434'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:46 devstack cinder-volume[88392]: WARNING cinder.quota [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1383823198 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1383823198, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:46 devstack cinder-volume[88392]: WARNING cinder.quota [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1383823198 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1383823198, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Created reservations ['ad72f2ea-2059-491f-b914-bf36ec9922f9', 'fbcf7251-b9c1-4621-8b9b-cc43b0d23ee5', '01e57426-ea97-45f4-b201-a113a540f86a', '42bc305d-d128-44ed-b9c9-d6b334729a86'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:46 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195" returned: 0 in 0.260s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:46 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:23:46 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99ea0bb-52ce-46f3-beab-8b3cb8e542b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c48cd9ca-94bf-4506-952d-73936ef0a195', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694e535a-882d-486d-ad28-6024fbee7360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:46 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Volume volume-c48cd9ca-94bf-4506-952d-73936ef0a195 (c48cd9ca-94bf-4506-952d-73936ef0a195): created successfully Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694e535a-882d-486d-ad28-6024fbee7360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Flow 'volume_create_manager' (ce45979a-49f9-4890-b9bb-910ad859e5d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b9ab781d-6723-49ee-a4d6-0ea9a34a8e51 tempest-VolumesDeleteCascade-1631690257 None] Created volume successfully. Jul 23 03:23:46 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.238s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:46 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3720582b-6d76-464c-92f9-9c4568d8e3b7 tempest-GroupsV314Test-1419546433 None] Delete group completed successfully. Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Acquiring lock "cinder-quobyte-8b04ef92-d61f-4039-8ab3-88532fe92d31" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Lock "cinder-quobyte-8b04ef92-d61f-4039-8ab3-88532fe92d31" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c622ab6-9047-47c9-883e-86a977b28f02]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:47 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 Jul 23 03:23:47 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] GroupSnapshot ec4c0110-d3c4-4065-b07a-5e4e5a828bef: creating. Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] Group snapshot ec4c0110-d3c4-4065-b07a-5e4e5a828bef: creating. {{(pid=88392) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] Creating offline snapshot 9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 of volume e40ade29-55f0-493a-9002-96e816de294c {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e40cfd-a88f-4d6c-8702-d3680e88b54c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:47 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c Jul 23 03:23:47 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:47 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31" returned: 0 in 0.460s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:47 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31 Jul 23 03:23:47 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:47 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:47 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c" returned: 0 in 0.437s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8b04ef92-d61f-4039-8ab3-88532fe92d31" returned: 0 in 0.284s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:47 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 1G Jul 23 03:23:47 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Lock "cinder-quobyte-8b04ef92-d61f-4039-8ab3-88532fe92d31" released by "delete_volume" :: held 0.844s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Created reservations ['78a153cd-723c-411c-b1f4-2a83a43c3f38'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Created reservations ['7465359f-da46-40ab-9bb1-0bd721d1c9b1', '7774d3ef-0b82-47da-9485-5ac25ee17b83', 'e5b363ab-a122-4c89-99eb-73a6e6cc08da', '7a8a6973-7a8e-4fbc-bdda-88a5c7c0434c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:48 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:23:48 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:48 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 1G" returned: 0 in 0.491s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40ade29-55f0-493a-9002-96e816de294c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:48 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40ade29-55f0-493a-9002-96e816de294c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 Jul 23 03:23:48 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:48 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.285s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:48 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7f16b4b0-a674-4a64-9bc0-e69d132fd536 tempest-GroupsV314Test-1419546433 None] Delete group completed successfully. Jul 23 03:23:48 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e40ade29-55f0-493a-9002-96e816de294c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840" returned: 0 in 0.356s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:48 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:23:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:48 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 Jul 23 03:23:48 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:49 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840" returned: 0 in 0.260s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:49 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.info Jul 23 03:23:49 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:49 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.info" returned: 0 in 0.272s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:49 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 03:23:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:49 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.info Jul 23 03:23:49 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:49 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.info" returned: 0 in 0.312s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.080s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] Creating offline snapshot 61022a6d-c587-4d65-a3cd-9fe593a2b8c2 of volume c48cd9ca-94bf-4506-952d-73936ef0a195 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:23:49 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dc776e-f3f5-44d9-9b3c-5d8cf0a7ef9a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:49 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-fb48b78b-2c66-4bf6-a1df-5a2379a1e91e tempest-GroupSnapshotsTest-2072320542 None] group_snapshot ec4c0110-d3c4-4065-b07a-5e4e5a828bef: created successfully Jul 23 03:23:49 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 Jul 23 03:23:49 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:50 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195" returned: 0 in 0.566s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:50 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 1G Jul 23 03:23:50 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Flow 'volume_create_manager' (bfd1464f-d142-4d9e-80f6-7f10b34b8349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d640bf4e-6c91-4d35-a5db-cb086f5f7c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d640bf4e-6c91-4d35-a5db-cb086f5f7c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1676629623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61acedc4-65fc-4dd8-8aa1-388e5cf26d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9663e8ce12ef450e82639bbe926ffbc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:51Z,use_quota=True,user_id='a8d5537487714530af69b74620fc7218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f691a9-9708-4cb1-b914-6806bc1148a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f691a9-9708-4cb1-b914-6806bc1148a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e60efa-334c-48eb-bbc8-a969b0a3a2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:50 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e60efa-334c-48eb-bbc8-a969b0a3a2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61acedc4-65fc-4dd8-8aa1-388e5cf26d83', 'volume_name': 'volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce804134-8481-4ada-9df9-561be9e92c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce804134-8481-4ada-9df9-561be9e92c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c0e85c-0905-46bb-9439-75507c036809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:50 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Volume 61acedc4-65fc-4dd8-8aa1-388e5cf26d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83', 'volume_size': 1} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:50 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] group_snapshot ec4c0110-d3c4-4065-b07a-5e4e5a828bef: deleting Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 1G" returned: 0 in 0.620s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c48cd9ca-94bf-4506-952d-73936ef0a195 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:50 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c48cd9ca-94bf-4506-952d-73936ef0a195 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 Jul 23 03:23:50 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] group_snapshot ec4c0110-d3c4-4065-b07a-5e4e5a828bef: deleting {{(pid=88392) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-e40ade29-55f0-493a-9002-96e816de294c" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-e40ade29-55f0-493a-9002-96e816de294c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-9e09fa2f-5f4f-4fc7-ae3f-2a4904474840" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-9e09fa2f-5f4f-4fc7-ae3f-2a4904474840" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Deleting offline snapshot 9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 of volume e40ade29-55f0-493a-9002-96e816de294c {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] snapshot_file for this snap is: volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee16d0d7-ca30-4517-881b-ecc57c4ffede]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:51 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 Jul 23 03:23:51 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:51 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c48cd9ca-94bf-4506-952d-73936ef0a195 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2" returned: 0 in 0.382s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:51 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 is being set with open permissions: ugo+rw Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:51 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 Jul 23 03:23:51 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:51 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840" returned: 0 in 0.416s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e40ade29-55f0-493a-9002-96e816de294c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ed2b85-f9f3-4d99-a897-9cea23e06118]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:51 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2" returned: 0 in 0.272s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:51 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.info Jul 23 03:23:51 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:51 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c Jul 23 03:23:51 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:51 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.info" returned: 0 in 0.294s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:51 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.info is being set with open permissions: ugo+rw Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:51 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.info Jul 23 03:23:51 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:51 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c" returned: 0 in 0.410s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:51 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 Jul 23 03:23:51 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:52 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.info" returned: 0 in 0.262s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1676629623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61acedc4-65fc-4dd8-8aa1-388e5cf26d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9663e8ce12ef450e82639bbe926ffbc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:51Z,use_quota=True,user_id='a8d5537487714530af69b74620fc7218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Creating volume 61acedc4-65fc-4dd8-8aa1-388e5cf26d83 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:52 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:52 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83 1073741824 Jul 23 03:23:52 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:52 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5f28c60e-6b12-46ff-bbdf-54f07aa6cb26 tempest-VolumesDeleteCascade-1631690257 None] Create snapshot completed successfully Jul 23 03:23:52 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840" returned: 0 in 0.368s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:52 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840 Jul 23 03:23:52 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:52 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c.9e09fa2f-5f4f-4fc7-ae3f-2a4904474840" returned: 0 in 0.272s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-9e09fa2f-5f4f-4fc7-ae3f-2a4904474840" released by "_delete_snapshot" :: held 1.608s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-e40ade29-55f0-493a-9002-96e816de294c" released by "delete_snapshot" :: held 1.643s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:52 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83 1073741824" returned: 0 in 0.492s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:52 devstack cinder-volume[88392]: WARNING cinder.quota [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-15001568 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-15001568, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:52 devstack cinder-volume[88392]: WARNING cinder.quota [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-15001568 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-15001568, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:52 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83 Jul 23 03:23:52 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:52 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['97f9ae0d-0475-4308-8197-ad14b86b3b80', 'd532d35b-4ed6-4655-a7c3-147da8d35bbc', '9f292a07-a562-41c1-b28f-0895f8ff130b', '14b26df6-e74b-40d8-9f0b-418b1878b28f'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:52 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-61261202-349c-44ba-9829-a669002b9645 tempest-GroupSnapshotsTest-2072320542 None] group_snapshot ec4c0110-d3c4-4065-b07a-5e4e5a828bef: deleted successfully Jul 23 03:23:53 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83" returned: 0 in 0.303s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c0e85c-0905-46bb-9439-75507c036809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ae89d0-4252-4d20-8ba5-99be1fda4e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:53 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Volume volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83 (61acedc4-65fc-4dd8-8aa1-388e5cf26d83): created successfully Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ae89d0-4252-4d20-8ba5-99be1fda4e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Flow 'volume_create_manager' (bfd1464f-d142-4d9e-80f6-7f10b34b8349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:53 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c6a488ab-0fae-4675-b4d1-560d99d0eb0e tempest-AttachVolumeShelveTestJSON-326588854 None] Created volume successfully. Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Flow 'volume_create_manager' (4258616c-7599-494f-ad90-130a3599bfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6813aeef-01c5-4074-9a52-bdccefc35d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "cinder-quobyte-e40ade29-55f0-493a-9002-96e816de294c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6813aeef-01c5-4074-9a52-bdccefc35d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1094661129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276faccc-e4f4-4e63-a7a4-6361d88029a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625a31faedf14304a2fcf1380e3f4ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61022a6d-c587-4d65-a3cd-9fe593a2b8c2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:23:53Z,use_quota=True,user_id='88b03dd327654e829d1a7732c0574c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cb62b3-dd6a-4085-866b-1b927e71fb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cb62b3-dd6a-4085-866b-1b927e71fb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770b4197-226f-4bc2-8abd-18aad60bd8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770b4197-226f-4bc2-8abd-18aad60bd8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '276faccc-e4f4-4e63-a7a4-6361d88029a2', 'volume_name': 'volume-276faccc-e4f4-4e63-a7a4-6361d88029a2', 'volume_size': 1, 'snapshot_id': '61022a6d-c587-4d65-a3cd-9fe593a2b8c2'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70bbfa1-1e55-452c-8a6e-81f276f8934d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70bbfa1-1e55-452c-8a6e-81f276f8934d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a677e0b0-f9be-47b5-ba93-caff9f1c25eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:23:53 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Volume 276faccc-e4f4-4e63-a7a4-6361d88029a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-276faccc-e4f4-4e63-a7a4-6361d88029a2', 'volume_size': 1, 'snapshot_id': '61022a6d-c587-4d65-a3cd-9fe593a2b8c2'} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-e40ade29-55f0-493a-9002-96e816de294c" acquired by "delete_volume" :: waited 0.062s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-quobyte-61022a6d-c587-4d65-a3cd-9fe593a2b8c2-276faccc-e4f4-4e63-a7a4-6361d88029a2" by "_create_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8939d6-1f8e-4e23-871b-664e1043e8e9]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-61022a6d-c587-4d65-a3cd-9fe593a2b8c2-276faccc-e4f4-4e63-a7a4-6361d88029a2" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Creating volume 276faccc-e4f4-4e63-a7a4-6361d88029a2 from snapshot 61022a6d-c587-4d65-a3cd-9fe593a2b8c2 {{(pid=88392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-quobyte-276faccc-e4f4-4e63-a7a4-6361d88029a2" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-276faccc-e4f4-4e63-a7a4-6361d88029a2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] snapshot: 61022a6d-c587-4d65-a3cd-9fe593a2b8c2, volume: 276faccc-e4f4-4e63-a7a4-6361d88029a2, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2317ed-59e2-4e1a-bd00-f8e16662b950]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:53 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c Jul 23 03:23:53 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:53 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 Jul 23 03:23:53 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:54 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c" returned: 0 in 0.428s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:54 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c Jul 23 03:23:54 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:54 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2" returned: 0 in 0.494s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c48cd9ca-94bf-4506-952d-73936ef0a195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4205c828-2d24-44ac-b785-9ce22452ab45]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:54 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e40ade29-55f0-493a-9002-96e816de294c" returned: 0 in 0.326s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:54 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 Jul 23 03:23:54 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Lock "cinder-quobyte-e40ade29-55f0-493a-9002-96e816de294c" released by "delete_volume" :: held 0.839s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['f76b3682-6555-4638-91e5-0db2eab6e360'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:54 devstack cinder-volume[88392]: WARNING cinder.quota [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-15001568 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-15001568, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Created reservations ['52454be9-a240-4c69-9475-83698d676219', 'fe558aa1-5105-4a83-92d5-4bed61a4b4e5', '714b8a61-0f27-4712-9c8b-72e3537c546d', '9bd2ec0c-b66d-4aa3-bcfc-5835307aae38'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:23:54 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195" returned: 0 in 0.477s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:23:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:23:54 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:23:54 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:54 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 Jul 23 03:23:54 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:23:55 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 23 03:23:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.284s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:23:55 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:23:55 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6e6d2a12-fc39-43a1-9dda-cf8976627f4d tempest-GroupSnapshotsTest-2072320542 None] Delete group completed successfully. Jul 23 03:24:00 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2" returned: 0 in 5.657s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:00 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[190ca243-fec1-4e1e-8465-f066521d0493]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:00 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 Jul 23 03:24:00 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:01 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195" returned: 0 in 0.604s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:01 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:24:01 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Converted 1024.00 MB image at 180.97 MB/s Jul 23 03:24:01 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 is being set with open permissions: ugo+rw Jul 23 03:24:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:01 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 Jul 23 03:24:01 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:01 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2" returned: 0 in 0.355s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-276faccc-e4f4-4e63-a7a4-6361d88029a2" released by "_copy_volume_from_snapshot" :: held 7.726s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-61022a6d-c587-4d65-a3cd-9fe593a2b8c2-276faccc-e4f4-4e63-a7a4-6361d88029a2" released by "_create_volume_from_snapshot" :: held 7.761s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.796s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a677e0b0-f9be-47b5-ba93-caff9f1c25eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276faccc-e4f4-4e63-a7a4-6361d88029a2', 'volume_size': 1, 'snapshot_id': '61022a6d-c587-4d65-a3cd-9fe593a2b8c2'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d305d7-f5db-406e-84de-7737874d1ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:01 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Volume volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 (276faccc-e4f4-4e63-a7a4-6361d88029a2): created successfully Jul 23 03:24:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d305d7-f5db-406e-84de-7737874d1ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Flow 'volume_create_manager' (4258616c-7599-494f-ad90-130a3599bfcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:01 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-78b21457-52d9-45c0-adf8-66e5c2ecd85f tempest-VolumesDeleteCascade-1631690257 None] Created volume successfully. Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-c48cd9ca-94bf-4506-952d-73936ef0a195-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-c48cd9ca-94bf-4506-952d-73936ef0a195-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Performing cascade delete. {{(pid=88392) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-61022a6d-c587-4d65-a3cd-9fe593a2b8c2-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-61022a6d-c587-4d65-a3cd-9fe593a2b8c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-quobyte-c48cd9ca-94bf-4506-952d-73936ef0a195" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-c48cd9ca-94bf-4506-952d-73936ef0a195" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-quobyte-61022a6d-c587-4d65-a3cd-9fe593a2b8c2" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-61022a6d-c587-4d65-a3cd-9fe593a2b8c2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Deleting offline snapshot 61022a6d-c587-4d65-a3cd-9fe593a2b8c2 of volume c48cd9ca-94bf-4506-952d-73936ef0a195 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] snapshot_file for this snap is: volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9643b5-6751-4351-9d8f-da13ab10bff8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:03 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 Jul 23 03:24:03 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:03 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2" returned: 0 in 0.470s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c48cd9ca-94bf-4506-952d-73936ef0a195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d3504b-4d30-4115-8d9e-52bdd076b570]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:03 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 Jul 23 03:24:03 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:04 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195" returned: 0 in 0.606s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:04 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 Jul 23 03:24:04 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:04 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2" returned: 0 in 0.444s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:04 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2 Jul 23 03:24:04 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:05 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195.61022a6d-c587-4d65-a3cd-9fe593a2b8c2" returned: 0 in 0.316s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-61022a6d-c587-4d65-a3cd-9fe593a2b8c2" released by "_delete_snapshot" :: held 1.983s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-c48cd9ca-94bf-4506-952d-73936ef0a195" released by "delete_snapshot" :: held 2.024s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:05 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Created reservations ['52288992-d7b7-4451-bba2-a571d1c53251', '042c5cc7-07a9-4fac-acde-9b44cc582f52', '17544158-21a5-4b32-a7b3-e24d9fb64518', 'eb5909b0-2e75-4982-a08a-0279fd2c6607'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:05 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Delete snapshot completed successfully. Jul 23 03:24:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-61022a6d-c587-4d65-a3cd-9fe593a2b8c2-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Snapshots deleted, issuing volume delete {{(pid=88392) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 23 03:24:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-quobyte-c48cd9ca-94bf-4506-952d-73936ef0a195" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-c48cd9ca-94bf-4506-952d-73936ef0a195" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[36da162a-2e8e-46f4-881f-8cadfbfc4b69]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:05 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 Jul 23 03:24:05 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:06 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195" returned: 0 in 0.673s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:06 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195 Jul 23 03:24:06 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:06 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c48cd9ca-94bf-4506-952d-73936ef0a195" returned: 0 in 0.286s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-c48cd9ca-94bf-4506-952d-73936ef0a195" released by "delete_volume" :: held 1.062s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Created reservations ['934699fc-335f-427f-8565-574b7b188e48', '31ac7d7f-bab4-43fb-b33e-83f7fb7f88ee', '35a6a619-7af2-4ee8-98ac-42506f96c7bb', '187bf3c2-d9ae-4c3f-9a40-26d8bb3912c9'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:06 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:06 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:06 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:06 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:07 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.358s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:07 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Deleted volume successfully. Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b28ca27e-0faa-4510-bdb8-c1a9941045ad tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-c48cd9ca-94bf-4506-952d-73936ef0a195-delete_volume" released by "delete_volume" :: held 4.037s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:07 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.388s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-276faccc-e4f4-4e63-a7a4-6361d88029a2-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-276faccc-e4f4-4e63-a7a4-6361d88029a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "cinder-quobyte-276faccc-e4f4-4e63-a7a4-6361d88029a2" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-276faccc-e4f4-4e63-a7a4-6361d88029a2" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe862350-4fb2-438f-a8bc-fef0e7433d01]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:07 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 Jul 23 03:24:07 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:08 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2" returned: 0 in 0.476s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:08 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2 Jul 23 03:24:08 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-bde1b8e3-fc39-499f-9952-2521a963da4e req-03cba984-05ff-4905-8aa2-474dd0f804f3 tempest-AttachVolumeShelveTestJSON-326588854 None] No connector for attachment df05ccab-2248-449f-9f91-dba6ef2e7eb6; skipping storage backend terminate_connection call. {{(pid=88392) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-bde1b8e3-fc39-499f-9952-2521a963da4e req-03cba984-05ff-4905-8aa2-474dd0f804f3 tempest-AttachVolumeShelveTestJSON-326588854 None] Deleting attachment df05ccab-2248-449f-9f91-dba6ef2e7eb6. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:24:08 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-276faccc-e4f4-4e63-a7a4-6361d88029a2" returned: 0 in 0.310s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-quobyte-276faccc-e4f4-4e63-a7a4-6361d88029a2" released by "delete_volume" :: held 0.844s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Created reservations ['15b63ccb-9fd9-4481-aa7f-7414e98b04a1', '4a8d62f0-aafc-4350-b00a-05efa2eaba8d', '255c874f-319b-4c05-bcce-ec240c55b999', '8109c5ff-ed23-49db-9e32-0b3f7a144eea'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:08 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:08 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:09 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.381s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:09 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:09 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Deleted volume successfully. Jul 23 03:24:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-18a34bc4-142d-4f32-b389-9dbf570d9fd1 tempest-VolumesDeleteCascade-1631690257 None] Lock "cinder-276faccc-e4f4-4e63-a7a4-6361d88029a2-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Flow 'volume_create_manager' (521dfaaa-eec5-4b7a-804f-aa6546eab513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c743173-c3ef-493b-b5b5-6f15536714d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c743173-c3ef-493b-b5b5-6f15536714d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1951930532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2a2602-4e1d-4a2e-a474-048185ec7b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a4a5da77ad468d8d47250a7f368d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:14Z,use_quota=True,user_id='e581a233244f47e1b44090865563af84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1842747-0fab-43ec-9984-349e94c87724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1842747-0fab-43ec-9984-349e94c87724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc02475-0a09-46c5-8dd8-edb23ced806b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc02475-0a09-46c5-8dd8-edb23ced806b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2a2602-4e1d-4a2e-a474-048185ec7b3d', 'volume_name': 'volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d', 'volume_size': 2}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77516624-cb8b-4c80-9450-159376611a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77516624-cb8b-4c80-9450-159376611a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a0df19-8500-4e9c-a1e2-ec0c6f64fed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:14 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Volume 8c2a2602-4e1d-4a2e-a474-048185ec7b3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d', 'volume_size': 2} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1951930532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2a2602-4e1d-4a2e-a474-048185ec7b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a4a5da77ad468d8d47250a7f368d90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:14Z,use_quota=True,user_id='e581a233244f47e1b44090865563af84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Creating volume 8c2a2602-4e1d-4a2e-a474-048185ec7b3d {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:14 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:24:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d 2147483648 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:14 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d 2147483648 Jul 23 03:24:14 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:15 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d 2147483648" returned: 0 in 0.696s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:15 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d Jul 23 03:24:15 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:15 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d" returned: 0 in 0.439s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a0df19-8500-4e9c-a1e2-ec0c6f64fed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d', 'volume_size': 2}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23681833-e730-4e1a-8133-479399c71fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:15 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Volume volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d (8c2a2602-4e1d-4a2e-a474-048185ec7b3d): created successfully Jul 23 03:24:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23681833-e730-4e1a-8133-479399c71fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Flow 'volume_create_manager' (521dfaaa-eec5-4b7a-804f-aa6546eab513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-55c5cea1-a907-4770-a116-bbb302e47c6c tempest-VolumesCloneNegativeTest-670714892 None] Created volume successfully. Jul 23 03:24:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Acquiring lock "cinder-8c2a2602-4e1d-4a2e-a474-048185ec7b3d-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Lock "cinder-8c2a2602-4e1d-4a2e-a474-048185ec7b3d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Acquiring lock "cinder-quobyte-8c2a2602-4e1d-4a2e-a474-048185ec7b3d" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Lock "cinder-quobyte-8c2a2602-4e1d-4a2e-a474-048185ec7b3d" acquired by "delete_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:17 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[11006657-31f0-4e5c-a559-96488c2bd14b]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:17 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d Jul 23 03:24:17 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:17 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d" returned: 0 in 0.504s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:17 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d Jul 23 03:24:17 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:17 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8c2a2602-4e1d-4a2e-a474-048185ec7b3d" returned: 0 in 0.278s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Lock "cinder-quobyte-8c2a2602-4e1d-4a2e-a474-048185ec7b3d" released by "delete_volume" :: held 0.847s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:18 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Created reservations ['ba320887-0ca7-4ca3-bf47-c6831dae486c', '0b89c5ea-d615-4f2c-8f8d-fcc5b6de7569', '550a2dec-e362-42e4-8b28-b473f7ec8660', '0b64dd70-7d90-442a-843a-a7bb988e1235'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:18 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:18 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:18 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.373s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:18 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:18 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Deleted volume successfully. Jul 23 03:24:18 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=146,cinder:UPDATE=177,cinder:INSERT=53,cinder:DELETE=8 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:24:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0aaba9a4-00a2-4a47-8f10-6b44f8192800 tempest-VolumesCloneNegativeTest-670714892 None] Lock "cinder-8c2a2602-4e1d-4a2e-a474-048185ec7b3d-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:23 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=162,cinder:INSERT=33,cinder:UPDATE=163,cinder:DELETE=6 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:24:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-06c6bdc9-4831-4f5f-b26b-3e5db362dea4 tempest-GroupsTest-1874634432 None] Group tempest-Group1-1234000815: creating Jul 23 03:24:23 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Flow 'volume_create_manager' (d6e141cb-ac72-4b5f-9107-8f02cfc9812f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77541589-26fe-4c41-8865-68c4618ed283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-06c6bdc9-4831-4f5f-b26b-3e5db362dea4 tempest-GroupsTest-1874634432 None] Group tempest-Group1-1234000815: created successfully Jul 23 03:24:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77541589-26fe-4c41-8865-68c4618ed283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1617882079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359c0585-eae6-45c0-ac61-2965c6f1191a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bee9953f41433ea5436499f27878ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:24Z,use_quota=True,user_id='efeb9e7bd1a540139cb87654b3a573ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6e7cdc-39ce-45ed-aee9-9b0d1db7de9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6e7cdc-39ce-45ed-aee9-9b0d1db7de9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff24932-c43b-421b-bd97-c5f1f2444c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:23 devstack cinder-volume[88392]: DEBUG cinder.image.glance [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Creating Keystone auth plugin from conf {{(pid=88392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:24:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-06c6bdc9-4831-4f5f-b26b-3e5db362dea4 tempest-GroupsTest-1874634432 None] Create group completed successfully. Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Flow 'volume_create_manager' (7bcf8f1f-d12e-4d52-b52d-c6f49a0dc5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca25121f-f656-45a2-acd2-0a35884e6483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca25121f-f656-45a2-acd2-0a35884e6483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1626413941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9960397-f6f0-4209-9b04-d25e3acf2ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a681933d3fd489b9a234610e6ea4f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:24Z,use_quota=True,user_id='84af37268980425bb7e849a1e78acb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751479a4-d5d2-4283-9124-b3c4da643262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751479a4-d5d2-4283-9124-b3c4da643262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa98bdf9-a91d-4d47-b494-cb2393f844c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa98bdf9-a91d-4d47-b494-cb2393f844c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9960397-f6f0-4209-9b04-d25e3acf2ab4', 'volume_name': 'volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569e2b2c-a3de-445f-a375-b26152fd864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569e2b2c-a3de-445f-a375-b26152fd864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39255650-08cf-4127-873e-e2a20691c9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:24 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Volume c9960397-f6f0-4209-9b04-d25e3acf2ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4', 'volume_size': 1} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1626413941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9960397-f6f0-4209-9b04-d25e3acf2ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a681933d3fd489b9a234610e6ea4f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:24Z,use_quota=True,user_id='84af37268980425bb7e849a1e78acb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Creating volume c9960397-f6f0-4209-9b04-d25e3acf2ab4 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:24 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:24 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 1073741824 Jul 23 03:24:24 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff24932-c43b-421b-bd97-c5f1f2444c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '359c0585-eae6-45c0-ac61-2965c6f1191a', 'volume_name': 'volume-359c0585-eae6-45c0-ac61-2965c6f1191a', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764ee9cb-ae59-4f76-8455-319a6e4c7906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764ee9cb-ae59-4f76-8455-319a6e4c7906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a00486f-1822-4e29-8a09-dabce4967b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:24 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Volume 359c0585-eae6-45c0-ac61-2965c6f1191a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-359c0585-eae6-45c0-ac61-2965c6f1191a', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Trying to clone 359c0585-eae6-45c0-ac61-2965c6f1191a from image 2d810839-198a-4642-93d6-ed27296a0802 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]). {{(pid=88392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:24:24 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Image download 20.69 MB at 20.69 MB/s Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f618010e-f4c0-4027-9db3-a23078c65343]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:24 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 1073741824" returned: 0 in 0.849s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-dd6c987f-4533-48e1-b238-f3c6b1db9ff9 tempest-GroupsTest-1874634432 None] Group tempest-Group2-1053820280: creating Jul 23 03:24:25 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 Jul 23 03:24:25 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-dd6c987f-4533-48e1-b238-f3c6b1db9ff9 tempest-GroupsTest-1874634432 None] Group tempest-Group2-1053820280: created successfully Jul 23 03:24:25 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD Jul 23 03:24:25 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-dd6c987f-4533-48e1-b238-f3c6b1db9ff9 tempest-GroupsTest-1874634432 None] Create group completed successfully. Jul 23 03:24:25 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4" returned: 0 in 0.356s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39255650-08cf-4127-873e-e2a20691c9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:25 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8373eb59-1918-4a2f-ba70-170d009c9e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Temporary image 2d810839-198a-4642-93d6-ed27296a0802 is fetched for user efeb9e7bd1a540139cb87654b3a573ca. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:24:25 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Volume volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 (c9960397-f6f0-4209-9b04-d25e3acf2ab4): created successfully Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8373eb59-1918-4a2f-ba70-170d009c9e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Flow 'volume_create_manager' (7bcf8f1f-d12e-4d52-b52d-c6f49a0dc5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ee9c213b-c6fe-4e35-a6a5-24be02b66b03 tempest-SnapshotMetadataTestJSON-1492282292 None] Created volume successfully. Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[07115320-042a-4c48-a7b9-cee9559f02ab]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:25 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD Jul 23 03:24:25 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:25 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1617882079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359c0585-eae6-45c0-ac61-2965c6f1191a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bee9953f41433ea5436499f27878ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:24Z,use_quota=True,user_id='efeb9e7bd1a540139cb87654b3a573ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Creating volume 359c0585-eae6-45c0-ac61-2965c6f1191a {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:25 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:24:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:25 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a 1073741824 Jul 23 03:24:25 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:26 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a 1073741824" returned: 0 in 0.593s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:26 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a Jul 23 03:24:26 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:26 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a" returned: 0 in 0.338s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.477s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:26 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Flow 'volume_create_manager' (8af68f04-252d-4b31-8651-182672b14884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26277e1-49c9-4642-b187-b95248a916e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] Creating offline snapshot 65ee543a-aa31-4ff5-a894-5edb9ca2552b of volume c9960397-f6f0-4209-9b04-d25e3acf2ab4 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26277e1-49c9-4642-b187-b95248a916e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-10351236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf40f8c0-301a-493a-b8c9-144cd82a4cee,host='devstack@QuobyteHD#QuobyteHD',id=8bd9af35-df1c-4852-9d63-b36445c75faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec77f81a4c654427a6c31d1807820cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:27Z,use_quota=True,user_id='09ffc75ac9f6467daff5be09d12c26d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d04751c7-a2fe-42e7-9363-e3a8eb58614f),volume_type_id=d04751c7-a2fe-42e7-9363-e3a8eb58614f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13f22ba-b2cd-4b1b-a871-a67f8c0ed185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13f22ba-b2cd-4b1b-a871-a67f8c0ed185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01ba8fc-dee2-4699-a13a-26271407094a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01ba8fc-dee2-4699-a13a-26271407094a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd9af35-df1c-4852-9d63-b36445c75faa', 'volume_name': 'volume-8bd9af35-df1c-4852-9d63-b36445c75faa', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ebed28-7441-4928-ab5e-8f1afbe4ac59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ebed28-7441-4928-ab5e-8f1afbe4ac59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d43b48-db95-4469-9754-dea06b2b2b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:27 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Volume 8bd9af35-df1c-4852-9d63-b36445c75faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd9af35-df1c-4852-9d63-b36445c75faa', 'volume_size': 1} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca47e289-3dcc-491d-8973-4c79af5781e3]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Attempting download of 2d810839-198a-4642-93d6-ed27296a0802 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}])) to volume 359c0585-eae6-45c0-ac61-2965c6f1191a. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f82237-2128-4279-b2b6-5a7deb1a8ee4]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_analirg4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:27 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 Jul 23 03:24:27 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:27 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_analirg4 Jul 23 03:24:27 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:27 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4" returned: 0 in 0.369s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:27 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b 1G Jul 23 03:24:27 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:27 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_analirg4" returned: 0 in 0.341s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_analirg4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:27 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_analirg4 Jul 23 03:24:27 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:27 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_analirg4" returned: 1 in 0.363s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_analirg4' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4992b563-ba7d-4de4-93c8-39b517bcdb06]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:27 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b 1G" returned: 0 in 0.436s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:27 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b Jul 23 03:24:27 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:27 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD Jul 23 03:24:27 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:28 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b" returned: 0 in 0.331s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:28 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b is being set with open permissions: ugo+rw Jul 23 03:24:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:28 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:28 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] 2d810839-198a-4642-93d6-ed27296a0802 was qcow2, converting to qcow2 {{(pid=88392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:24:28 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b Jul 23 03:24:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:28 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:28 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a Jul 23 03:24:28 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:28 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b" returned: 0 in 0.241s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:28 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.info Jul 23 03:24:28 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:28 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.info" returned: 0 in 0.284s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:28 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.info is being set with open permissions: ugo+rw Jul 23 03:24:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:28 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.info Jul 23 03:24:28 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:29 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.info" returned: 0 in 0.298s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.044s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bf40f8c0-301a-493a-b8c9-144cd82a4cee,created_at=2026-07-23T01:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-10351236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf40f8c0-301a-493a-b8c9-144cd82a4cee,host='devstack@QuobyteHD#QuobyteHD',id=8bd9af35-df1c-4852-9d63-b36445c75faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec77f81a4c654427a6c31d1807820cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:27Z,use_quota=True,user_id='09ffc75ac9f6467daff5be09d12c26d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d04751c7-a2fe-42e7-9363-e3a8eb58614f),volume_type_id=d04751c7-a2fe-42e7-9363-e3a8eb58614f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Creating volume 8bd9af35-df1c-4852-9d63-b36445c75faa {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:29 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:29 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa 1073741824 Jul 23 03:24:29 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:29 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4399f5bb-88ca-47c8-a3e9-c62673864f44 tempest-SnapshotMetadataTestJSON-1492282292 None] Create snapshot completed successfully Jul 23 03:24:29 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa 1073741824" returned: 0 in 0.578s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:29 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa Jul 23 03:24:29 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:30 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:30 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa" returned: 0 in 0.345s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a" returned: 0 in 1.870s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_pwjoa3vxdevstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:24:30 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Converted 112.00 MB image at 59.79 MB/s Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d43b48-db95-4469-9754-dea06b2b2b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd9af35-df1c-4852-9d63-b36445c75faa', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:30 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a 1G Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f51f21e-39a9-495e-909a-1c3a5b3bf7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:30 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:30 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Volume volume-8bd9af35-df1c-4852-9d63-b36445c75faa (8bd9af35-df1c-4852-9d63-b36445c75faa): created successfully Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f51f21e-39a9-495e-909a-1c3a5b3bf7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Flow 'volume_create_manager' (8af68f04-252d-4b31-8651-182672b14884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-df5bc0ab-bfc2-46f8-8154-6395e7ea0f2c tempest-GroupsTest-1874634432 None] Created volume successfully. Jul 23 03:24:30 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Acquiring lock "cinder-65ee543a-aa31-4ff5-a894-5edb9ca2552b-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a 1G" returned: 0 in 0.398s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Downloaded image 2d810839-198a-4642-93d6-ed27296a0802 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}])) to volume 359c0585-eae6-45c0-ac61-2965c6f1191a successfully. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Temporary image 2d810839-198a-4642-93d6-ed27296a0802 for user efeb9e7bd1a540139cb87654b3a573ca is deleted. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Marking volume 359c0585-eae6-45c0-ac61-2965c6f1191a as bootable. {{(pid=88392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "cinder-65ee543a-aa31-4ff5-a894-5edb9ca2552b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Acquiring lock "cinder-quobyte-c9960397-f6f0-4209-9b04-d25e3acf2ab4" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Copying metadata from image 2d810839-198a-4642-93d6-ed27296a0802 to 359c0585-eae6-45c0-ac61-2965c6f1191a. {{(pid=88392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Creating volume glance metadata for volume 359c0585-eae6-45c0-ac61-2965c6f1191a backed by image 2d810839-198a-4642-93d6-ed27296a0802 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "cinder-quobyte-c9960397-f6f0-4209-9b04-d25e3acf2ab4" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Acquiring lock "cinder-quobyte-65ee543a-aa31-4ff5-a894-5edb9ca2552b" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "cinder-quobyte-65ee543a-aa31-4ff5-a894-5edb9ca2552b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Deleting offline snapshot 65ee543a-aa31-4ff5-a894-5edb9ca2552b of volume c9960397-f6f0-4209-9b04-d25e3acf2ab4 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] snapshot_file for this snap is: volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[319176b2-dff8-4187-81fa-11f281fe1724]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a00486f-1822-4e29-8a09-dabce4967b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359c0585-eae6-45c0-ac61-2965c6f1191a', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b6ab03-d071-4f0e-99e7-e24973608cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:30 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Volume volume-359c0585-eae6-45c0-ac61-2965c6f1191a (359c0585-eae6-45c0-ac61-2965c6f1191a): created successfully Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b6ab03-d071-4f0e-99e7-e24973608cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Flow 'volume_create_manager' (d6e141cb-ac72-4b5f-9107-8f02cfc9812f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1e730557-56b3-4c78-8154-f33e9dae2589 tempest-VolumesExtendTest-2060320638 None] Created volume successfully. Jul 23 03:24:30 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b Jul 23 03:24:30 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:31 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b" returned: 0 in 0.481s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e813e1e0-f73d-4cbf-a109-c524b51897b5]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Acquiring lock "cinder-quobyte-8bd9af35-df1c-4852-9d63-b36445c75faa" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Lock "cinder-quobyte-8bd9af35-df1c-4852-9d63-b36445c75faa" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b0cf87-1311-4d09-a994-8257e7152193]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:31 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 Jul 23 03:24:31 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-640897a8-0dbb-4283-abf1-f518820ae7ae tempest-VolumesExtendTest-2060320638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-640897a8-0dbb-4283-abf1-f518820ae7ae tempest-VolumesExtendTest-2060320638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:31 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa Jul 23 03:24:31 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83727e4-5821-47b5-939a-ada138f632c4]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-640897a8-0dbb-4283-abf1-f518820ae7ae tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:31 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a Jul 23 03:24:31 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:31 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4" returned: 0 in 0.615s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:31 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b Jul 23 03:24:31 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:31 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa" returned: 0 in 0.564s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:31 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa Jul 23 03:24:31 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:32 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-640897a8-0dbb-4283-abf1-f518820ae7ae tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a" returned: 0 in 0.550s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-640897a8-0dbb-4283-abf1-f518820ae7ae tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a 2G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-640897a8-0dbb-4283-abf1-f518820ae7ae tempest-VolumesExtendTest-2060320638 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a 2G" returned: 0 in 0.105s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-640897a8-0dbb-4283-abf1-f518820ae7ae tempest-VolumesExtendTest-2060320638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.688s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:32 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b" returned: 0 in 0.417s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:32 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b Jul 23 03:24:32 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:32 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-640897a8-0dbb-4283-abf1-f518820ae7ae tempest-VolumesExtendTest-2060320638 None] Extend volume completed successfully. Jul 23 03:24:32 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8bd9af35-df1c-4852-9d63-b36445c75faa" returned: 0 in 0.447s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Lock "cinder-quobyte-8bd9af35-df1c-4852-9d63-b36445c75faa" released by "delete_volume" :: held 1.075s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Created reservations ['c82c9c86-61bf-4754-a732-8847bd514cd7'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:32 devstack cinder-volume[88392]: WARNING cinder.quota [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2132655367 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2132655367, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:24:32 devstack cinder-volume[88392]: WARNING cinder.quota [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2132655367 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2132655367, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Created reservations ['e551fb0e-c2d5-41f8-b6b0-5ab1f9aa1301', '185177d3-fd86-4b43-ac30-289ff5eb33a8', '45acc99a-b72e-4486-b997-4c138f79d816', 'c167f731-77e5-4803-a66e-e173b2330331'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:32 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4.65ee543a-aa31-4ff5-a894-5edb9ca2552b" returned: 0 in 0.421s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "cinder-quobyte-65ee543a-aa31-4ff5-a894-5edb9ca2552b" released by "_delete_snapshot" :: held 2.082s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "cinder-quobyte-c9960397-f6f0-4209-9b04-d25e3acf2ab4" released by "delete_snapshot" :: held 2.135s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:32 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:32 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Created reservations ['a125b819-30e0-4f37-a749-7c2b1ce0082c', '14175b73-b640-44b1-955a-21f9bcfa6a38', 'bc6ae58e-879e-491e-befe-9480cfb077bc', '80c3e916-b9aa-4233-b9c1-425f61b993e6'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:32 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Delete snapshot completed successfully. Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "cinder-359c0585-eae6-45c0-ac61-2965c6f1191a-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-21426b6c-17ad-44e5-903f-640e1f814cab tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "cinder-65ee543a-aa31-4ff5-a894-5edb9ca2552b-delete_snapshot" released by "delete_snapshot" :: held 2.359s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-359c0585-eae6-45c0-ac61-2965c6f1191a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "cinder-quobyte-359c0585-eae6-45c0-ac61-2965c6f1191a" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-quobyte-359c0585-eae6-45c0-ac61-2965c6f1191a" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[20afac7e-8c2b-4e82-9e5a-f587ee9406dd]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:33 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.340s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:33 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c0be5da9-eba1-4296-b4f1-459aab198a53 tempest-GroupsTest-1874634432 None] Delete group completed successfully. Jul 23 03:24:33 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a Jul 23 03:24:33 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:33 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a" returned: 0 in 0.383s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:33 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a Jul 23 03:24:33 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:33 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-359c0585-eae6-45c0-ac61-2965c6f1191a" returned: 0 in 0.240s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-quobyte-359c0585-eae6-45c0-ac61-2965c6f1191a" released by "delete_volume" :: held 0.667s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Created reservations ['35aab8b1-6777-46c5-a354-4eccd1a7e65e', 'f2b1771f-a852-4d4e-97ac-beae5a1caff1', '31ee3975-0d04-4fe0-ba81-0290225e3958', 'd63ee113-c738-48f9-ba3f-b176f81824ef'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:33 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Acquiring lock "cinder-c9960397-f6f0-4209-9b04-d25e3acf2ab4-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:33 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "cinder-c9960397-f6f0-4209-9b04-d25e3acf2ab4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Acquiring lock "cinder-quobyte-c9960397-f6f0-4209-9b04-d25e3acf2ab4" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "cinder-quobyte-c9960397-f6f0-4209-9b04-d25e3acf2ab4" acquired by "delete_volume" :: waited 0.032s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-db5af686-d6ab-4c17-b3f8-d52052deaf33 tempest-GroupsTest-1874634432 None] Created reservations ['21722954-3f86-457a-84ae-e750cc77f536'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ffae90-7626-450f-9384-1a287db398c2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-db5af686-d6ab-4c17-b3f8-d52052deaf33 tempest-GroupsTest-1874634432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-db5af686-d6ab-4c17-b3f8-d52052deaf33 tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-db5af686-d6ab-4c17-b3f8-d52052deaf33 tempest-GroupsTest-1874634432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-db5af686-d6ab-4c17-b3f8-d52052deaf33 tempest-GroupsTest-1874634432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-db5af686-d6ab-4c17-b3f8-d52052deaf33 tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-db5af686-d6ab-4c17-b3f8-d52052deaf33 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:34 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:34 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:34 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.525s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:34 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 Jul 23 03:24:34 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:34 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Deleted volume successfully. Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f5573a99-d8af-4db2-a581-1c7169cfae22 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-359c0585-eae6-45c0-ac61-2965c6f1191a-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:34 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-db5af686-d6ab-4c17-b3f8-d52052deaf33 tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.435s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-db5af686-d6ab-4c17-b3f8-d52052deaf33 tempest-GroupsTest-1874634432 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:34 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-db5af686-d6ab-4c17-b3f8-d52052deaf33 tempest-GroupsTest-1874634432 None] Delete group completed successfully. Jul 23 03:24:34 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4" returned: 0 in 0.557s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:34 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4 Jul 23 03:24:34 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Flow 'volume_create_manager' (b8d86c9b-194d-4583-a613-a340a3efd754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59bafa0c-97fc-4100-807b-16b57a1010a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59bafa0c-97fc-4100-807b-16b57a1010a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-527748125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bee9953f41433ea5436499f27878ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:35Z,use_quota=True,user_id='efeb9e7bd1a540139cb87654b3a573ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8df9aae-8927-4f92-9a3c-5d0ab458732e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8df9aae-8927-4f92-9a3c-5d0ab458732e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa423832-a67a-4855-90b1-38d3114a0155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa423832-a67a-4855-90b1-38d3114a0155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1eaf4ad-fc55-48de-a1d2-6f631e71bc1f', 'volume_name': 'volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cc223e-9f4d-44b7-b88c-a4991df4a5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cc223e-9f4d-44b7-b88c-a4991df4a5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e014ffb-be73-4d2b-b68d-bc9f03fd02ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:34 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Volume d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f', 'volume_size': 1} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-527748125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68bee9953f41433ea5436499f27878ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:35Z,use_quota=True,user_id='efeb9e7bd1a540139cb87654b3a573ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Creating volume d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:34 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:34 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f 1073741824 Jul 23 03:24:34 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:34 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c9960397-f6f0-4209-9b04-d25e3acf2ab4" returned: 0 in 0.271s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "cinder-quobyte-c9960397-f6f0-4209-9b04-d25e3acf2ab4" released by "delete_volume" :: held 0.937s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Created reservations ['f8371c08-bdfc-4b64-9198-90c8bf48a648', '327e5e56-138d-48e4-a4e6-2764ebab4a29', 'ff58534b-d13f-42e2-b9d9-9120006f126a', 'e259eb43-c469-454d-bfd2-a51494d6d84d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:35 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:35 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:35 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f 1073741824" returned: 0 in 0.615s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:35 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.375s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:35 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Deleted volume successfully. Jul 23 03:24:35 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f Jul 23 03:24:35 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-14345dd1-70f2-43e4-a26b-381825425aa9 tempest-SnapshotMetadataTestJSON-1492282292 None] Lock "cinder-c9960397-f6f0-4209-9b04-d25e3acf2ab4-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:35 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f6056bae-4834-4f0c-b629-11f5dbc6949b tempest-GroupsTest-1874634432 None] Group tempest-GroupsTest-Group-1552828625: creating Jul 23 03:24:35 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f6056bae-4834-4f0c-b629-11f5dbc6949b tempest-GroupsTest-1874634432 None] Group tempest-GroupsTest-Group-1552828625: created successfully Jul 23 03:24:35 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f6056bae-4834-4f0c-b629-11f5dbc6949b tempest-GroupsTest-1874634432 None] Create group completed successfully. Jul 23 03:24:35 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" returned: 0 in 0.302s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e014ffb-be73-4d2b-b68d-bc9f03fd02ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d040d1-f6a7-482e-95fa-790119ba1544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:35 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Volume volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f (d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f): created successfully Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d040d1-f6a7-482e-95fa-790119ba1544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Flow 'volume_create_manager' (b8d86c9b-194d-4583-a613-a340a3efd754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:35 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-cf5086e6-2aad-4b73-b7c8-3e31b94e0b9d tempest-VolumesExtendTest-2060320638 None] Created volume successfully. Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] Creating offline snapshot 8b6f2360-15ee-4f20-8671-f654899c6fc3 of volume d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd89aa43-d2b4-42e1-9434-3eeaa76e8965]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:37 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f Jul 23 03:24:37 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Flow 'volume_create_manager' (27ff7904-9d63-484f-bda9-21948632cffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45773f31-9cdb-42ce-8e22-867af233d4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45773f31-9cdb-42ce-8e22-867af233d4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-92327678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31eb0867-09ab-4581-9492-a9648e266a6d,host='devstack@QuobyteHD#QuobyteHD',id=afccf375-6171-481f-b02e-ca620e07b4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec77f81a4c654427a6c31d1807820cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:37Z,use_quota=True,user_id='09ffc75ac9f6467daff5be09d12c26d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b79724c7-d0d2-4f87-b779-0d2aee62f00e),volume_type_id=b79724c7-d0d2-4f87-b779-0d2aee62f00e)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1298d07-550a-426d-b780-47f1bd8c411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1298d07-550a-426d-b780-47f1bd8c411d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170ad7e7-4319-4a8a-adce-12e3df8c051b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170ad7e7-4319-4a8a-adce-12e3df8c051b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afccf375-6171-481f-b02e-ca620e07b4d7', 'volume_name': 'volume-afccf375-6171-481f-b02e-ca620e07b4d7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5345b53-624a-4ce9-977e-cecdddd53b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5345b53-624a-4ce9-977e-cecdddd53b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c894c815-8ed5-4cb0-af87-84b793e23cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:37 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Volume afccf375-6171-481f-b02e-ca620e07b4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afccf375-6171-481f-b02e-ca620e07b4d7', 'volume_size': 1} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:37 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" returned: 0 in 0.445s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:37 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 1G Jul 23 03:24:37 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:38 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 1G" returned: 0 in 0.469s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:38 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 Jul 23 03:24:38 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:38 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3" returned: 0 in 0.313s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:38 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 is being set with open permissions: ugo+rw Jul 23 03:24:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:38 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 Jul 23 03:24:38 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:38 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3" returned: 0 in 0.256s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:38 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.info Jul 23 03:24:38 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:39 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.info" returned: 0 in 0.264s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:39 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.info is being set with open permissions: ugo+rw Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:39 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.info Jul 23 03:24:39 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:39 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.info" returned: 0 in 0.266s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.126s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.715s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=31eb0867-09ab-4581-9492-a9648e266a6d,created_at=2026-07-23T01:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-92327678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31eb0867-09ab-4581-9492-a9648e266a6d,host='devstack@QuobyteHD#QuobyteHD',id=afccf375-6171-481f-b02e-ca620e07b4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec77f81a4c654427a6c31d1807820cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:37Z,use_quota=True,user_id='09ffc75ac9f6467daff5be09d12c26d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b79724c7-d0d2-4f87-b779-0d2aee62f00e),volume_type_id=b79724c7-d0d2-4f87-b779-0d2aee62f00e)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Creating volume afccf375-6171-481f-b02e-ca620e07b4d7 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:39 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:39 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7 1073741824 Jul 23 03:24:39 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-df22c126-eda9-44c3-be0a-ab63437b1e91 tempest-VolumesExtendTest-2060320638 None] Create snapshot completed successfully Jul 23 03:24:39 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7 1073741824" returned: 0 in 0.467s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:39 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7 Jul 23 03:24:39 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:40 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7" returned: 0 in 0.294s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c894c815-8ed5-4cb0-af87-84b793e23cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afccf375-6171-481f-b02e-ca620e07b4d7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8f0de1-2999-4f1a-80a7-e2d8be934f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Volume volume-afccf375-6171-481f-b02e-ca620e07b4d7 (afccf375-6171-481f-b02e-ca620e07b4d7): created successfully Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8f0de1-2999-4f1a-80a7-e2d8be934f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Flow 'volume_create_manager' (27ff7904-9d63-484f-bda9-21948632cffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:40 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-65281196-a44d-49c1-95ed-02c81920d9c1 tempest-GroupsTest-1874634432 None] Created volume successfully. Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-057f2738-6a65-4ca8-896d-7649a6a568a3 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-057f2738-6a65-4ca8-896d-7649a6a568a3 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[943281d8-2492-4733-9a93-743c46d0f83f]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-057f2738-6a65-4ca8-896d-7649a6a568a3 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:40 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f Jul 23 03:24:40 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:40 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-057f2738-6a65-4ca8-896d-7649a6a568a3 tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" returned: 0 in 0.384s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-057f2738-6a65-4ca8-896d-7649a6a568a3 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 2G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-057f2738-6a65-4ca8-896d-7649a6a568a3 tempest-VolumesExtendTest-2060320638 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 2G" returned: 0 in 0.157s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-057f2738-6a65-4ca8-896d-7649a6a568a3 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.581s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:41 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-057f2738-6a65-4ca8-896d-7649a6a568a3 tempest-VolumesExtendTest-2060320638 None] Extend volume completed successfully. Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Flow 'volume_create_manager' (53ade24f-510f-4fee-99e8-bb64f185d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3007527f-5b1c-426b-93e4-4d3122d1604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3007527f-5b1c-426b-93e4-4d3122d1604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1545565353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31eb0867-09ab-4581-9492-a9648e266a6d,host='devstack@QuobyteHD#QuobyteHD',id=cae6ff48-c848-4fee-8f7f-91354b7604ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec77f81a4c654427a6c31d1807820cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:42Z,use_quota=True,user_id='09ffc75ac9f6467daff5be09d12c26d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b79724c7-d0d2-4f87-b779-0d2aee62f00e),volume_type_id=b79724c7-d0d2-4f87-b779-0d2aee62f00e)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af468f5d-3758-4161-9c96-9c8bb00974ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af468f5d-3758-4161-9c96-9c8bb00974ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6319399-8053-4410-8c4e-4868108f5ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6319399-8053-4410-8c4e-4868108f5ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae6ff48-c848-4fee-8f7f-91354b7604ae', 'volume_name': 'volume-cae6ff48-c848-4fee-8f7f-91354b7604ae', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2b1906-124a-4a90-8483-ad2277132193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2b1906-124a-4a90-8483-ad2277132193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b43753-850b-4fa9-acd2-5403e7b705d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:41 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Volume cae6ff48-c848-4fee-8f7f-91354b7604ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae6ff48-c848-4fee-8f7f-91354b7604ae', 'volume_size': 1} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=31eb0867-09ab-4581-9492-a9648e266a6d,created_at=2026-07-23T01:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1545565353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31eb0867-09ab-4581-9492-a9648e266a6d,host='devstack@QuobyteHD#QuobyteHD',id=cae6ff48-c848-4fee-8f7f-91354b7604ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec77f81a4c654427a6c31d1807820cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:42Z,use_quota=True,user_id='09ffc75ac9f6467daff5be09d12c26d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b79724c7-d0d2-4f87-b779-0d2aee62f00e),volume_type_id=b79724c7-d0d2-4f87-b779-0d2aee62f00e)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Creating volume cae6ff48-c848-4fee-8f7f-91354b7604ae {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:41 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "cinder-8b6f2360-15ee-4f20-8671-f654899c6fc3-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:41 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae 1073741824 Jul 23 03:24:41 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-8b6f2360-15ee-4f20-8671-f654899c6fc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "cinder-quobyte-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-quobyte-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "cinder-quobyte-8b6f2360-15ee-4f20-8671-f654899c6fc3" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-quobyte-8b6f2360-15ee-4f20-8671-f654899c6fc3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Deleting offline snapshot 8b6f2360-15ee-4f20-8671-f654899c6fc3 of volume d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] snapshot_file for this snap is: volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[668fecf1-f56c-4ee8-9211-8a229d3254d1]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:42 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 Jul 23 03:24:42 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:42 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3" returned: 0 in 0.422s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:24:42 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[434c960d-5fac-4369-b692-daf3cb7c2640]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae 1073741824" returned: 0 in 0.623s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:42 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae Jul 23 03:24:42 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:42 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f Jul 23 03:24:42 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:42 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae" returned: 0 in 0.260s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b43753-850b-4fa9-acd2-5403e7b705d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae6ff48-c848-4fee-8f7f-91354b7604ae', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466695ab-bb37-4c61-9723-92fefd8870cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:42 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Volume volume-cae6ff48-c848-4fee-8f7f-91354b7604ae (cae6ff48-c848-4fee-8f7f-91354b7604ae): created successfully Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466695ab-bb37-4c61-9723-92fefd8870cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Flow 'volume_create_manager' (53ade24f-510f-4fee-99e8-bb64f185d576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:42 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f1a69080-620a-4325-8120-50913d971be2 tempest-GroupsTest-1874634432 None] Created volume successfully. Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" returned: 0 in 0.399s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:42 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 Jul 23 03:24:42 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:43 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3" returned: 0 in 0.386s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:43 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3 Jul 23 03:24:43 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:43 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f.8b6f2360-15ee-4f20-8671-f654899c6fc3" returned: 0 in 0.270s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-quobyte-8b6f2360-15ee-4f20-8671-f654899c6fc3" released by "_delete_snapshot" :: held 1.638s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-quobyte-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" released by "delete_snapshot" :: held 1.668s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Created reservations ['833fc550-3be2-48b9-b5fa-80b19dbb10e8', '76d410ee-5668-47b1-b62c-df8a34f8b53c', 'ecf3091e-dcc3-489c-8982-6f5bdd117b66', '1978d716-524b-42aa-ac07-d9ff2d060ade'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Flow 'volume_create_manager' (e07ca203-0770-4216-8e8b-6cd93647c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dca9b0c-810a-46da-9893-0bec89ab6cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dca9b0c-810a-46da-9893-0bec89ab6cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1828510987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3b8724-968e-47dc-ad4d-3a1fc23fc96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4327ed2f7f433da6396f21fdedff32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:44Z,use_quota=True,user_id='9cac086864244d4c9558d43a65b2f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e1752c-6aa5-4032-ac90-71064202e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e1752c-6aa5-4032-ac90-71064202e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffe051d-a2c0-4a3c-a4bd-2936066e750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffe051d-a2c0-4a3c-a4bd-2936066e750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3b8724-968e-47dc-ad4d-3a1fc23fc96f', 'volume_name': 'volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d427992-2e02-4229-89dc-7c73e0723f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d427992-2e02-4229-89dc-7c73e0723f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1fbd46-9a87-417a-a842-58c5dc9b011d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:43 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Volume 6b3b8724-968e-47dc-ad4d-3a1fc23fc96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f', 'volume_size': 1} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1828510987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3b8724-968e-47dc-ad4d-3a1fc23fc96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4327ed2f7f433da6396f21fdedff32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:44Z,use_quota=True,user_id='9cac086864244d4c9558d43a65b2f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Creating volume 6b3b8724-968e-47dc-ad4d-3a1fc23fc96f {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:43 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:43 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f 1073741824 Jul 23 03:24:43 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:43 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Delete snapshot completed successfully. Jul 23 03:24:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-87f0f215-3d5c-435d-bbe1-f4bd17a83425 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-8b6f2360-15ee-4f20-8671-f654899c6fc3-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "cinder-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "cinder-quobyte-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-quobyte-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ccf8e8-84da-46d5-8ac6-e8334f1a7250]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:44 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f 1073741824" returned: 0 in 0.588s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:44 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:44 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:44 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f Jul 23 03:24:44 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-cbc3d4bd-8909-43a4-8171-55dc54cc930b tempest-GroupsTest-1874634432 None] Update group completed successfully. Jul 23 03:24:44 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f" returned: 0 in 0.278s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1fbd46-9a87-417a-a842-58c5dc9b011d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41261bb-81ef-4fbf-8b0f-a6c7e59c36bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:44 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Volume volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f (6b3b8724-968e-47dc-ad4d-3a1fc23fc96f): created successfully Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41261bb-81ef-4fbf-8b0f-a6c7e59c36bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Flow 'volume_create_manager' (e07ca203-0770-4216-8e8b-6cd93647c311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:44 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" returned: 0 in 0.481s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2e2e32c5-f941-4046-8092-dc7137b882fb tempest-VolumesTransfersTest-1054753940 None] Created volume successfully. Jul 23 03:24:44 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f Jul 23 03:24:44 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:44 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" returned: 0 in 0.273s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-quobyte-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f" released by "delete_volume" :: held 0.845s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Created reservations ['e3006429-5b8f-4a28-b4e1-5a1a24e069e3', '4834574b-934a-4239-89c0-239e2d6f8a10', '9ecdfff8-0d80-47ec-85de-e43ed4930dfc', 'c0606584-fc8c-4213-b620-b74bdabeee3c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:45 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:45 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:45 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.296s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Deleted volume successfully. Jul 23 03:24:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d2a9a8c4-5588-4753-88a9-f136035e05a3 tempest-VolumesExtendTest-2060320638 None] Lock "cinder-d1eaf4ad-fc55-48de-a1d2-6f631e71bc1f-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0db072d2-2d04-4f1a-b135-bbecca72f4bf tempest-GroupsTest-1874634432 None] Update group completed successfully. Jul 23 03:24:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-15727812-2a5c-4305-b61c-02e1f09d5942 tempest-VolumesTransfersTest-488635551 None] Transfer volume completed successfully. Jul 23 03:24:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Acquiring lock "cinder-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Lock "cinder-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Acquiring lock "cinder-quobyte-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Lock "cinder-quobyte-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c82f496-6263-4b0b-92c0-1be567cb71b2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Acquiring lock "cinder-quobyte-afccf375-6171-481f-b02e-ca620e07b4d7" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Lock "cinder-quobyte-afccf375-6171-481f-b02e-ca620e07b4d7" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa99f01-5e56-4b59-9677-21984036b275]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:48 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f Jul 23 03:24:48 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:48 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7 Jul 23 03:24:48 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:48 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f" returned: 0 in 0.496s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:48 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f Jul 23 03:24:48 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:48 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7" returned: 0 in 0.543s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:48 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7 Jul 23 03:24:48 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:48 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f" returned: 0 in 0.276s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Lock "cinder-quobyte-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f" released by "delete_volume" :: held 0.873s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:48 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Created reservations ['1ac96c33-2379-422e-8f21-1eee2e84c8f1', '19384839-1056-4d2a-9f99-c41c625d9b38', 'da05f013-154b-44b2-8919-251437730178', '5dd22a49-b8b2-4537-8ac1-b643aeb7dc10'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:49 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:49 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:49 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-afccf375-6171-481f-b02e-ca620e07b4d7" returned: 0 in 0.408s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Lock "cinder-quobyte-afccf375-6171-481f-b02e-ca620e07b4d7" released by "delete_volume" :: held 1.024s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Acquiring lock "cinder-quobyte-cae6ff48-c848-4fee-8f7f-91354b7604ae" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Lock "cinder-quobyte-cae6ff48-c848-4fee-8f7f-91354b7604ae" acquired by "delete_volume" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b655c-5806-4d8f-828b-1b58426fc558]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:49 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae Jul 23 03:24:49 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:49 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.369s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:49 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Deleted volume successfully. Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ef34071-e9b1-44c7-beb4-4b427956a51d tempest-VolumesTransfersTest-520417695 None] Lock "cinder-6b3b8724-968e-47dc-ad4d-3a1fc23fc96f-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:49 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae" returned: 0 in 0.457s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:49 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae Jul 23 03:24:49 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:49 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-cae6ff48-c848-4fee-8f7f-91354b7604ae" returned: 0 in 0.302s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Lock "cinder-quobyte-cae6ff48-c848-4fee-8f7f-91354b7604ae" released by "delete_volume" :: held 0.818s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Created reservations ['a9e7a4c9-de53-4938-9cc1-ed60fcfa2535'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Flow 'volume_create_manager' (bf306b9c-d0a1-4ad3-8314-e9d22a190614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cafda3-4e37-435b-b272-0b4d7a4d7cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cafda3-4e37-435b-b272-0b4d7a4d7cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-315613117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c431d1a-dc39-43db-adf1-e8483653dbcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0134f9a80346068f46af23a6d87781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:50Z,use_quota=True,user_id='520455f241b94406a96f4b0115d5639b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0163156-7a1e-4de1-95f2-07a9d1e8b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0163156-7a1e-4de1-95f2-07a9d1e8b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fe1bf8-acf4-4760-9485-3d6a4ca49ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fe1bf8-acf4-4760-9485-3d6a4ca49ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c431d1a-dc39-43db-adf1-e8483653dbcb', 'volume_name': 'volume-5c431d1a-dc39-43db-adf1-e8483653dbcb', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f166bd-b2cc-4e91-b4ee-b4ac32e8ea4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f166bd-b2cc-4e91-b4ee-b4ac32e8ea4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17df922b-9fbd-422b-87c4-40e69b168e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:50 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Volume 5c431d1a-dc39-43db-adf1-e8483653dbcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c431d1a-dc39-43db-adf1-e8483653dbcb', 'volume_size': 1} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-315613117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c431d1a-dc39-43db-adf1-e8483653dbcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0134f9a80346068f46af23a6d87781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:50Z,use_quota=True,user_id='520455f241b94406a96f4b0115d5639b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Creating volume 5c431d1a-dc39-43db-adf1-e8483653dbcb {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:50 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:50 devstack cinder-volume[88392]: WARNING cinder.quota [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1083287693 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1083287693, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:24:50 devstack cinder-volume[88392]: WARNING cinder.quota [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1083287693 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1083287693, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:24:50 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb 1073741824 Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Acquiring lock "cinder-61acedc4-65fc-4dd8-8aa1-388e5cf26d83-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:50 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Created reservations ['a5bd4a77-52f3-4e0b-b868-c24f6043580e', '73a0e9a2-0a55-4160-b5d8-dfb4e2e68f06', '58b35fb9-928c-4eaa-be04-718121ed2d5d', 'dc1a5ac1-cf09-49ed-889c-a5a68d634a09'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Lock "cinder-61acedc4-65fc-4dd8-8aa1-388e5cf26d83-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Acquiring lock "cinder-quobyte-61acedc4-65fc-4dd8-8aa1-388e5cf26d83" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Lock "cinder-quobyte-61acedc4-65fc-4dd8-8aa1-388e5cf26d83" acquired by "delete_volume" :: waited 0.040s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b58a84-8825-438b-ad22-0e4469235dda]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Created reservations ['a8ceca4d-044c-437f-b5f2-29499d863dc3', '1c83216c-517a-46b9-bc20-9a9d574b392e', '20d4ffa7-9e4e-4189-b64b-b2b37650f321', '0a0f8461-396f-499f-8251-a9990078fcdd'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:50 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83 Jul 23 03:24:50 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:50 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:50 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:51 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83" returned: 0 in 0.493s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:24:51 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83 Jul 23 03:24:51 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Flow 'volume_create_manager' (1b3b4ace-3af8-4ff0-9996-653ea25942b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab33c9cf-efff-42fb-9747-c49058408618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab33c9cf-efff-42fb-9747-c49058408618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-921652113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ed44db-711c-43ce-a684-f620242a7b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4327ed2f7f433da6396f21fdedff32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:51Z,use_quota=True,user_id='9cac086864244d4c9558d43a65b2f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:51 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e9b1b1-0f52-4c57-8b77-1bd81be7f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e9b1b1-0f52-4c57-8b77-1bd81be7f63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87f1bbb-234f-4409-8507-54bb459cd0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87f1bbb-234f-4409-8507-54bb459cd0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ed44db-711c-43ce-a684-f620242a7b39', 'volume_name': 'volume-16ed44db-711c-43ce-a684-f620242a7b39', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fba2fe-d86b-4102-b608-5961e7700416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fba2fe-d86b-4102-b608-5961e7700416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8a189c-a4e7-4af2-8b39-2eb243baac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:51 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Volume 16ed44db-711c-43ce-a684-f620242a7b39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ed44db-711c-43ce-a684-f620242a7b39', 'volume_size': 1} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.339s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:51 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3332cce1-83b9-4b0e-ad52-9ebca69eeea7 tempest-GroupsTest-1874634432 None] Delete group completed successfully. Jul 23 03:24:51 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb 1073741824" returned: 0 in 0.872s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:51 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb Jul 23 03:24:51 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:51 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61acedc4-65fc-4dd8-8aa1-388e5cf26d83" returned: 0 in 0.298s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Lock "cinder-quobyte-61acedc4-65fc-4dd8-8aa1-388e5cf26d83" released by "delete_volume" :: held 0.856s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Created reservations ['de1a5fd7-cb8c-4a89-b92d-42fcaf367cd0', '73369cba-e7e1-410a-8b53-43465e3f38b6', '01615d11-1cd1-447a-813c-f8a63df14416', 'a29a8cf9-2cf7-46fc-aac8-53d4d8b8f107'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:51 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:51 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:51 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb" returned: 0 in 0.272s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-921652113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ed44db-711c-43ce-a684-f620242a7b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4327ed2f7f433da6396f21fdedff32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:24:51Z,use_quota=True,user_id='9cac086864244d4c9558d43a65b2f8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Creating volume 16ed44db-711c-43ce-a684-f620242a7b39 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:24:51 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:51 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39 1073741824 Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17df922b-9fbd-422b-87c4-40e69b168e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c431d1a-dc39-43db-adf1-e8483653dbcb', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:51 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57150173-ef50-4b80-b714-720925f2a2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:51 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Volume volume-5c431d1a-dc39-43db-adf1-e8483653dbcb (5c431d1a-dc39-43db-adf1-e8483653dbcb): created successfully Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57150173-ef50-4b80-b714-720925f2a2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Flow 'volume_create_manager' (bf306b9c-d0a1-4ad3-8314-e9d22a190614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:51 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3a10a139-a4be-4f94-a9d9-8b328cecab43 tempest-VolumesNegativeTest-571915205 None] Created volume successfully. Jul 23 03:24:51 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.316s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:51 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Deleted volume successfully. Jul 23 03:24:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-737f47d7-3d4b-45cf-b539-346c46ffc40f tempest-AttachVolumeShelveTestJSON-326588854 None] Lock "cinder-61acedc4-65fc-4dd8-8aa1-388e5cf26d83-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:52 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39 1073741824" returned: 0 in 0.629s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:52 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39 Jul 23 03:24:52 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:52 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39" returned: 0 in 0.371s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:24:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8a189c-a4e7-4af2-8b39-2eb243baac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ed44db-711c-43ce-a684-f620242a7b39', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a539d624-ffd0-474c-8e97-c91418b50697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:24:52 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Volume volume-16ed44db-711c-43ce-a684-f620242a7b39 (16ed44db-711c-43ce-a684-f620242a7b39): created successfully Jul 23 03:24:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a539d624-ffd0-474c-8e97-c91418b50697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:24:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Flow 'volume_create_manager' (1b3b4ace-3af8-4ff0-9996-653ea25942b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:24:52 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1feabd67-cd9d-46ee-8522-2b0e2ec597be tempest-VolumesTransfersTest-1054753940 None] Created volume successfully. Jul 23 03:24:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Acquiring lock "cinder-16ed44db-711c-43ce-a684-f620242a7b39-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Lock "cinder-16ed44db-711c-43ce-a684-f620242a7b39-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Acquiring lock "cinder-quobyte-16ed44db-711c-43ce-a684-f620242a7b39" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:24:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Lock "cinder-quobyte-16ed44db-711c-43ce-a684-f620242a7b39" acquired by "delete_volume" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:24:53 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c062f278-75ad-4412-b671-7de8d47e086c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:24:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:53 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39 Jul 23 03:24:53 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:54 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39" returned: 0 in 0.524s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:54 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39 Jul 23 03:24:54 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:54 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16ed44db-711c-43ce-a684-f620242a7b39" returned: 0 in 0.412s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:54 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Lock "cinder-quobyte-16ed44db-711c-43ce-a684-f620242a7b39" released by "delete_volume" :: held 1.018s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:24:54 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Created reservations ['3641db8e-27b1-4a44-b623-9381aca71bbb', '0b2007ad-b65b-4b62-998c-73acfed94795', '025cea6b-dbbe-46f3-96f0-8a1ed53a2468', '255432b1-7140-48f3-9828-ad08d92945d6'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:24:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:24:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:24:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:24:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:24:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:24:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:24:54 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:24:54 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:24:55 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jul 23 03:24:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.399s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:24:55 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:24:55 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Deleted volume successfully. Jul 23 03:24:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b18ecf48-23b6-481a-b13e-89065c569b9e tempest-VolumesTransfersTest-520417695 None] Lock "cinder-16ed44db-711c-43ce-a684-f620242a7b39-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Flow 'volume_create_manager' (7d355a5a-c819-4ca0-8a8c-325b7c18d351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b79c286-1ae4-4d72-b581-8ee40a458dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b79c286-1ae4-4d72-b581-8ee40a458dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1568857213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72d77f9-793f-4130-9315-34ee6bd4c90d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e781e6ecb64c4dbf874557a912b7ffc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:04Z,use_quota=True,user_id='549305444af04726b2405c931f5f5df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a88327-59f4-47da-8b08-8295e4bc998f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a88327-59f4-47da-8b08-8295e4bc998f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216fe204-0c07-47a4-b9ba-6819ecd8bfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216fe204-0c07-47a4-b9ba-6819ecd8bfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72d77f9-793f-4130-9315-34ee6bd4c90d', 'volume_name': 'volume-e72d77f9-793f-4130-9315-34ee6bd4c90d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d048858-e4eb-45d0-b015-cd62b73f4a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d048858-e4eb-45d0-b015-cd62b73f4a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340f9a2c-df7e-49ed-b58e-059a7adc1e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:04 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Volume e72d77f9-793f-4130-9315-34ee6bd4c90d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72d77f9-793f-4130-9315-34ee6bd4c90d', 'volume_size': 1} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1568857213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72d77f9-793f-4130-9315-34ee6bd4c90d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e781e6ecb64c4dbf874557a912b7ffc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:04Z,use_quota=True,user_id='549305444af04726b2405c931f5f5df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Creating volume e72d77f9-793f-4130-9315-34ee6bd4c90d {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:04 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:04 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d 1073741824 Jul 23 03:25:04 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:05 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d 1073741824" returned: 0 in 0.794s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:05 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d Jul 23 03:25:05 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:05 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d" returned: 0 in 0.529s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340f9a2c-df7e-49ed-b58e-059a7adc1e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72d77f9-793f-4130-9315-34ee6bd4c90d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee4e784-9ebc-421a-9b2f-4810b7774dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:05 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Volume volume-e72d77f9-793f-4130-9315-34ee6bd4c90d (e72d77f9-793f-4130-9315-34ee6bd4c90d): created successfully Jul 23 03:25:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee4e784-9ebc-421a-9b2f-4810b7774dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Flow 'volume_create_manager' (7d355a5a-c819-4ca0-8a8c-325b7c18d351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:05 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-da0a1080-afca-4e49-ae43-457163d11664 req-422df3fc-a611-4123-ae5e-9a9535dc9c91 tempest-VolumesGetTestJSON-536773537 None] Created volume successfully. Jul 23 03:25:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Acquiring lock "cinder-e72d77f9-793f-4130-9315-34ee6bd4c90d-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:25:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Lock "cinder-e72d77f9-793f-4130-9315-34ee6bd4c90d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:06 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:06 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Acquiring lock "cinder-quobyte-e72d77f9-793f-4130-9315-34ee6bd4c90d" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Lock "cinder-quobyte-e72d77f9-793f-4130-9315-34ee6bd4c90d" acquired by "delete_volume" :: waited 0.030s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0c55d5-0a8c-41c0-bed1-b80d4b035cf3]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:07 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d Jul 23 03:25:07 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:07 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.550s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:25:07 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d" returned: 0 in 0.534s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:07 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d Jul 23 03:25:07 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:07 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e72d77f9-793f-4130-9315-34ee6bd4c90d" returned: 0 in 0.302s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Lock "cinder-quobyte-e72d77f9-793f-4130-9315-34ee6bd4c90d" released by "delete_volume" :: held 0.911s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:08 devstack cinder-volume[88392]: DEBUG cinder.quota [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Created reservations ['a58c2054-1a4e-4a6a-a11c-6e1359618e46', 'b5405caa-c972-471a-92e6-efb885f66942', 'a6ac6582-3711-40b0-b0c3-5c8b201130e2', '47a69755-fa03-41cb-bea4-355822bb2174'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:08 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:08 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:08 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.293s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:08 devstack cinder-volume[88392]: DEBUG cinder.manager [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:08 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Deleted volume successfully. Jul 23 03:25:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-42298393-1fc1-4ca5-890c-7d9893eafe00 req-4c22ec33-5653-4cce-88b5-6322624343c8 tempest-VolumesGetTestJSON-536773537 None] Lock "cinder-e72d77f9-793f-4130-9315-34ee6bd4c90d-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Flow 'volume_create_manager' (b04b8a16-7d6a-447f-9221-d634a4d9b8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ae2cbc-4ed4-4143-9eb1-ef09d65abf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ae2cbc-4ed4-4143-9eb1-ef09d65abf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-132757926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdcd0e52-9c64-4802-a4d0-60c16695faaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d53d8a60524af0b37999cb4ef40e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:09Z,use_quota=True,user_id='0302cf96f0484c5d8bb3251298a5a7f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e85625-488a-4374-bad5-622375bf2c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e85625-488a-4374-bad5-622375bf2c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ef00cc-ac43-4bf6-aaee-7e18d1e14fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ef00cc-ac43-4bf6-aaee-7e18d1e14fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdcd0e52-9c64-4802-a4d0-60c16695faaa', 'volume_name': 'volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ada02d-5a80-43d0-bf57-338076905876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ada02d-5a80-43d0-bf57-338076905876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ae1161-e6b5-4b1c-a416-d5afb5f7dcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:09 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Volume bdcd0e52-9c64-4802-a4d0-60c16695faaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa', 'volume_size': 1} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-132757926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdcd0e52-9c64-4802-a4d0-60c16695faaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d53d8a60524af0b37999cb4ef40e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:09Z,use_quota=True,user_id='0302cf96f0484c5d8bb3251298a5a7f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Creating volume bdcd0e52-9c64-4802-a4d0-60c16695faaa {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:09 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:09 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa 1073741824 Jul 23 03:25:09 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:09 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa 1073741824" returned: 0 in 0.723s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:10 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa Jul 23 03:25:10 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:10 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa" returned: 0 in 0.283s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:10 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ae1161-e6b5-4b1c-a416-d5afb5f7dcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:10 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561f80de-d780-4cfe-bbed-f89c2374f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:10 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Volume volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa (bdcd0e52-9c64-4802-a4d0-60c16695faaa): created successfully Jul 23 03:25:10 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561f80de-d780-4cfe-bbed-f89c2374f630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:10 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Flow 'volume_create_manager' (b04b8a16-7d6a-447f-9221-d634a4d9b8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:10 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f9ebf03d-644d-4d08-83d5-7c408cc8b6c0 tempest-VolumesTransfersV355Test-1933209804 None] Created volume successfully. Jul 23 03:25:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-828540e0-530f-4f59-9e4a-c45714563ace tempest-VolumesTransfersV355Test-327355758 None] Transfer volume completed successfully. Jul 23 03:25:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Acquiring lock "cinder-bdcd0e52-9c64-4802-a4d0-60c16695faaa-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Lock "cinder-bdcd0e52-9c64-4802-a4d0-60c16695faaa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Acquiring lock "cinder-quobyte-bdcd0e52-9c64-4802-a4d0-60c16695faaa" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Lock "cinder-quobyte-bdcd0e52-9c64-4802-a4d0-60c16695faaa" acquired by "delete_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:12 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6e9a12-901b-4ca6-8965-3c85dcf5dba7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:12 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa Jul 23 03:25:12 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:13 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa" returned: 0 in 0.441s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:13 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa Jul 23 03:25:13 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:13 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-bdcd0e52-9c64-4802-a4d0-60c16695faaa" returned: 0 in 0.315s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Lock "cinder-quobyte-bdcd0e52-9c64-4802-a4d0-60c16695faaa" released by "delete_volume" :: held 0.813s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:13 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Created reservations ['ba6d68e4-022c-4d5a-a6d3-693042b419f7', '73da24de-b29f-4888-ae18-9335281a61eb', 'e8b9502e-3231-43dd-8c26-0d432d491433', '07c9bc37-21b9-4781-b1d4-e225ced8d1e3'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:13 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:13 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:14 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.341s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:14 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Deleted volume successfully. Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e2b25da-ed7a-4707-bcc2-a6a1f5db36f6 tempest-VolumesTransfersV355Test-1250707802 None] Lock "cinder-bdcd0e52-9c64-4802-a4d0-60c16695faaa-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Flow 'volume_create_manager' (3f13cd7f-f7ec-4c0f-8d4e-2e3def6cf8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97059d10-5fd8-41b6-ac54-6194e440b359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97059d10-5fd8-41b6-ac54-6194e440b359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1053578864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3999a8f8-83b3-4010-8b84-4798cce1beb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d53d8a60524af0b37999cb4ef40e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:14Z,use_quota=True,user_id='0302cf96f0484c5d8bb3251298a5a7f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69dd5b40-a4fa-447c-b69b-6737bddb7c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69dd5b40-a4fa-447c-b69b-6737bddb7c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138e0da9-e555-4899-883a-b25254bec5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138e0da9-e555-4899-883a-b25254bec5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3999a8f8-83b3-4010-8b84-4798cce1beb7', 'volume_name': 'volume-3999a8f8-83b3-4010-8b84-4798cce1beb7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d953f741-d56c-466d-9dfe-257a7718f124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d953f741-d56c-466d-9dfe-257a7718f124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb7a860-8d97-4f63-aa6d-e4b19540c4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:14 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Volume 3999a8f8-83b3-4010-8b84-4798cce1beb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3999a8f8-83b3-4010-8b84-4798cce1beb7', 'volume_size': 1} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1053578864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3999a8f8-83b3-4010-8b84-4798cce1beb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d53d8a60524af0b37999cb4ef40e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:14Z,use_quota=True,user_id='0302cf96f0484c5d8bb3251298a5a7f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Creating volume 3999a8f8-83b3-4010-8b84-4798cce1beb7 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:14 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:14 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7 1073741824 Jul 23 03:25:14 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:15 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7 1073741824" returned: 0 in 0.635s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Flow 'volume_create_manager' (0c0a1558-0910-4b2d-94e3-94c55c61ae92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4231e4a-4c6d-4eeb-b398-0b7a7113fe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4231e4a-4c6d-4eeb-b398-0b7a7113fe2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1868591312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6ac590-8d48-4da5-9b08-9879db5c9b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e85e160f15642ab9b164c8cae885772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:15Z,use_quota=True,user_id='8f747806fcf04841a662e06d570a1a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878dcefb-01b6-4469-8624-bffe68f97754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878dcefb-01b6-4469-8624-bffe68f97754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5431738-a4fe-4e1a-9112-9a4c947c6123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5431738-a4fe-4e1a-9112-9a4c947c6123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6ac590-8d48-4da5-9b08-9879db5c9b58', 'volume_name': 'volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b258128-27c8-4ff1-ab35-29d699fd36b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b258128-27c8-4ff1-ab35-29d699fd36b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cffba7-bf15-4251-a2b9-1a1656bfde16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:15 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Volume 3e6ac590-8d48-4da5-9b08-9879db5c9b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58', 'volume_size': 1} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:15 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7 Jul 23 03:25:15 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:15 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7" returned: 0 in 0.311s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1868591312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6ac590-8d48-4da5-9b08-9879db5c9b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e85e160f15642ab9b164c8cae885772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:15Z,use_quota=True,user_id='8f747806fcf04841a662e06d570a1a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Creating volume 3e6ac590-8d48-4da5-9b08-9879db5c9b58 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:15 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb7a860-8d97-4f63-aa6d-e4b19540c4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3999a8f8-83b3-4010-8b84-4798cce1beb7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34678f7b-20a7-4717-bd31-f4973826f36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:15 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58 1073741824 Jul 23 03:25:15 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:15 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Volume volume-3999a8f8-83b3-4010-8b84-4798cce1beb7 (3999a8f8-83b3-4010-8b84-4798cce1beb7): created successfully Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34678f7b-20a7-4717-bd31-f4973826f36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Flow 'volume_create_manager' (3f13cd7f-f7ec-4c0f-8d4e-2e3def6cf8b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a5a69c59-bd06-4bfc-a6b0-092883ac4f77 tempest-VolumesTransfersV355Test-1933209804 None] Created volume successfully. Jul 23 03:25:16 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58 1073741824" returned: 0 in 0.668s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:16 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58 Jul 23 03:25:16 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:16 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58" returned: 0 in 0.479s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26cffba7-bf15-4251-a2b9-1a1656bfde16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f52cd65-5197-433b-9055-330dd3a3a3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:16 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Volume volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58 (3e6ac590-8d48-4da5-9b08-9879db5c9b58): created successfully Jul 23 03:25:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f52cd65-5197-433b-9055-330dd3a3a3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Flow 'volume_create_manager' (0c0a1558-0910-4b2d-94e3-94c55c61ae92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1706bc97-bc7a-4c32-8c25-17880e6e7f21 tempest-VolumeQuotasNegativeTestJSON-970305813 None] Created volume successfully. Jul 23 03:25:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Acquiring lock "cinder-3999a8f8-83b3-4010-8b84-4798cce1beb7-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Lock "cinder-3999a8f8-83b3-4010-8b84-4798cce1beb7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Acquiring lock "cinder-quobyte-3999a8f8-83b3-4010-8b84-4798cce1beb7" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Lock "cinder-quobyte-3999a8f8-83b3-4010-8b84-4798cce1beb7" acquired by "delete_volume" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:17 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e662e249-58a0-461a-8b2b-2edeb50087d5]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:17 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7 Jul 23 03:25:17 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:17 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7" returned: 0 in 0.621s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:17 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7 Jul 23 03:25:17 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Acquiring lock "cinder-5c431d1a-dc39-43db-adf1-e8483653dbcb-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Lock "cinder-5c431d1a-dc39-43db-adf1-e8483653dbcb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Acquiring lock "cinder-quobyte-5c431d1a-dc39-43db-adf1-e8483653dbcb" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Lock "cinder-quobyte-5c431d1a-dc39-43db-adf1-e8483653dbcb" acquired by "delete_volume" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:18 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3999a8f8-83b3-4010-8b84-4798cce1beb7" returned: 0 in 0.488s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Lock "cinder-quobyte-3999a8f8-83b3-4010-8b84-4798cce1beb7" released by "delete_volume" :: held 1.180s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[de14e7f1-2dd0-4e28-aa9d-8f55c65dfcc6]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Created reservations ['a2a2fdea-4f5e-4fa1-a06a-011a83c923b5', '3858495e-b15e-4ae6-8a67-c6892f7d9219', '2225175c-cc78-4408-82a4-2dd6825a1d4a', 'd0bbadb2-3dcf-47fd-a2a9-43660524bf8a'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:18 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb Jul 23 03:25:18 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:18 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:18 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Acquiring lock "cinder-3e6ac590-8d48-4da5-9b08-9879db5c9b58-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Lock "cinder-3e6ac590-8d48-4da5-9b08-9879db5c9b58-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=154,cinder:UPDATE=180,cinder:INSERT=40,cinder:DELETE=13 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Acquiring lock "cinder-quobyte-3e6ac590-8d48-4da5-9b08-9879db5c9b58" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Lock "cinder-quobyte-3e6ac590-8d48-4da5-9b08-9879db5c9b58" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ca070f-24f8-430c-9399-2d5b2e134f71]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:18 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.347s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:18 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Deleted volume successfully. Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8d88b52f-b61b-4fd4-9e7c-28137db00826 tempest-VolumesTransfersV355Test-1250707802 None] Lock "cinder-3999a8f8-83b3-4010-8b84-4798cce1beb7-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:18 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb" returned: 0 in 0.549s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:19 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb Jul 23 03:25:19 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:19 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58 Jul 23 03:25:19 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:19 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5c431d1a-dc39-43db-adf1-e8483653dbcb" returned: 0 in 0.303s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Lock "cinder-quobyte-5c431d1a-dc39-43db-adf1-e8483653dbcb" released by "delete_volume" :: held 0.922s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Created reservations ['c0e4985c-d28b-4f14-8ecc-5bd19c001e9a', 'dff4e9b5-9df7-4337-a1bd-afc0ff8ae02a', 'dd75e393-31b2-4078-968b-b48a81ee25a7', '59a8d567-d69c-43f2-946d-1b19cac30602'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:19 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58" returned: 0 in 0.484s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:19 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58 Jul 23 03:25:19 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:19 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:19 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:19 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e6ac590-8d48-4da5-9b08-9879db5c9b58" returned: 0 in 0.351s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Lock "cinder-quobyte-3e6ac590-8d48-4da5-9b08-9879db5c9b58" released by "delete_volume" :: held 0.890s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:19 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.335s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:19 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Deleted volume successfully. Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2eda1529-069b-45a1-a24b-3921c0748634 tempest-VolumesNegativeTest-571915205 None] Lock "cinder-5c431d1a-dc39-43db-adf1-e8483653dbcb-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Created reservations ['e60f2b32-8027-44eb-8438-552a180b5606', 'f6a463f8-3bbb-4316-b9b0-b2618190dcd2', '456c565b-e150-4fad-9ace-7c7410494eb3', '2ea75c7b-6187-4cfa-b5d0-886b31644c02'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:20 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:20 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:20 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.318s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:20 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:20 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Deleted volume successfully. Jul 23 03:25:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d5b6603c-51db-4c02-b53f-f2c0e38d0b9f tempest-VolumeQuotasNegativeTestJSON-970305813 None] Lock "cinder-3e6ac590-8d48-4da5-9b08-9879db5c9b58-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:20 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Flow 'volume_create_manager' (f5f6246f-48e4-411b-a6c1-81a45412f67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d848a156-44f9-4561-9a38-2005a643d602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d848a156-44f9-4561-9a38-2005a643d602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1309523328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0c06c4-e63f-42cc-9beb-d7501a447dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f9582cc33f47eaba7b3861104d5a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:21Z,use_quota=True,user_id='a1f475d6ecc84f08b67626ad3e23877b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea9bfa7-96bb-4de3-afe0-b03240513aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea9bfa7-96bb-4de3-afe0-b03240513aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c00d6c-9ca0-4579-bc61-2c38d53c1a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c00d6c-9ca0-4579-bc61-2c38d53c1a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0c06c4-e63f-42cc-9beb-d7501a447dd2', 'volume_name': 'volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc354664-84ae-4d14-81db-8ac45cbdeb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc354664-84ae-4d14-81db-8ac45cbdeb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a330b35-eadc-460f-a235-00f5b10ff99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:21 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2', 'volume_size': 1} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1309523328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0c06c4-e63f-42cc-9beb-d7501a447dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f9582cc33f47eaba7b3861104d5a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:21Z,use_quota=True,user_id='a1f475d6ecc84f08b67626ad3e23877b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Creating volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:21 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:21 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 1073741824 Jul 23 03:25:21 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:21 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 1073741824" returned: 0 in 0.643s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:21 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 Jul 23 03:25:21 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:22 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" returned: 0 in 0.355s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a330b35-eadc-460f-a235-00f5b10ff99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b372601-1fed-437d-8ec6-a5752f8440f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:22 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Volume volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 (7c0c06c4-e63f-42cc-9beb-d7501a447dd2): created successfully Jul 23 03:25:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b372601-1fed-437d-8ec6-a5752f8440f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Flow 'volume_create_manager' (f5f6246f-48e4-411b-a6c1-81a45412f67d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:22 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-79bde855-21b7-4a26-9297-b85aacb927c1 tempest-SnapshotsActionsTest-1954076103 None] Created volume successfully. Jul 23 03:25:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] Creating offline snapshot e36ef4df-7b6d-4fb4-934c-6fe96b524677 of volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:25:23 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4900e309-9631-4d41-9ff9-f33b9537eff8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:23 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 Jul 23 03:25:23 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:23 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" returned: 0 in 0.471s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:24 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 1G Jul 23 03:25:24 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Flow 'volume_create_manager' (927b9a11-a702-438e-83b7-5b25da3503ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f402d504-d58a-48fb-b03a-4326957278fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f402d504-d58a-48fb-b03a-4326957278fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2077994704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43de597e-ab6d-45bc-8358-2fe859821c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ad32022317481eb283c50c9a24a558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:24Z,use_quota=True,user_id='7e9b1785b603470f80ef2d051fd45ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3ab2b0-b4ba-4e27-8fe3-eae43d368b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3ab2b0-b4ba-4e27-8fe3-eae43d368b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6151810c-f326-40ea-b47c-b3fe4ad9bd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6151810c-f326-40ea-b47c-b3fe4ad9bd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43de597e-ab6d-45bc-8358-2fe859821c48', 'volume_name': 'volume-43de597e-ab6d-45bc-8358-2fe859821c48', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb5e581-ae33-4a61-9f42-be4c790cc1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb5e581-ae33-4a61-9f42-be4c790cc1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff839bb-26ef-4bbf-ba90-204d4eb2cf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:24 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Volume 43de597e-ab6d-45bc-8358-2fe859821c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43de597e-ab6d-45bc-8358-2fe859821c48', 'volume_size': 1} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:24 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 1G" returned: 0 in 0.564s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:24 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:25:24 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:24 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.320s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:24 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 is being set with open permissions: ugo+rw Jul 23 03:25:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:24 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:25:24 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:25 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.280s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=177,cinder:SELECT=131,cinder:INSERT=50,cinder:DELETE=13 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:25 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.info Jul 23 03:25:25 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:25 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.info" returned: 0 in 0.274s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:25 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.info is being set with open permissions: ugo+rw Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:25 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.info Jul 23 03:25:25 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:25 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.info" returned: 0 in 0.261s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.357s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2077994704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43de597e-ab6d-45bc-8358-2fe859821c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ad32022317481eb283c50c9a24a558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:24Z,use_quota=True,user_id='7e9b1785b603470f80ef2d051fd45ab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Creating volume 43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:25 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:25 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 1073741824 Jul 23 03:25:25 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2446fef6-1154-41a7-9891-3d971cd2fde6 tempest-SnapshotsActionsTest-1954076103 None] Create snapshot completed successfully Jul 23 03:25:26 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 1073741824" returned: 0 in 0.562s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:26 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 Jul 23 03:25:26 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:26 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48" returned: 0 in 0.289s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff839bb-26ef-4bbf-ba90-204d4eb2cf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43de597e-ab6d-45bc-8358-2fe859821c48', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5121570b-b01f-486c-ae5b-273144d37204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:26 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Volume volume-43de597e-ab6d-45bc-8358-2fe859821c48 (43de597e-ab6d-45bc-8358-2fe859821c48): created successfully Jul 23 03:25:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5121570b-b01f-486c-ae5b-273144d37204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Flow 'volume_create_manager' (927b9a11-a702-438e-83b7-5b25da3503ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:26 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b54712e1-4998-4978-8fe3-793f48c98d83 tempest-VolumesSnapshotListTestJSON-588420697 None] Created volume successfully. Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (d01bc27c-035c-4184-accc-ab6de5c956c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c762cd-bf79-4a39-b00b-47e290f552b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c762cd-bf79-4a39-b00b-47e290f552b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-578621746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a322c01-d912-4c04-a950-c9b74d62c665,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:27Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b974df80-79b7-4b07-806c-5a3ef7dde4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b974df80-79b7-4b07-806c-5a3ef7dde4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb32e2e0-eb29-4c26-985c-598d42038940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb32e2e0-eb29-4c26-985c-598d42038940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a322c01-d912-4c04-a950-c9b74d62c665', 'volume_name': 'volume-9a322c01-d912-4c04-a950-c9b74d62c665', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2673496-78d7-4641-8a78-41cd91ab0825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2673496-78d7-4641-8a78-41cd91ab0825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81975e9-79ac-417a-bc61-b1576e595eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:27 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Volume 9a322c01-d912-4c04-a950-c9b74d62c665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a322c01-d912-4c04-a950-c9b74d62c665', 'volume_size': 1} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-578621746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a322c01-d912-4c04-a950-c9b74d62c665,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:27Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Creating volume 9a322c01-d912-4c04-a950-c9b74d62c665 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:27 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:27 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665 1073741824 Jul 23 03:25:27 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:27 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665 1073741824" returned: 0 in 0.478s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:27 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665 Jul 23 03:25:27 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:28 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665" returned: 0 in 0.262s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.759s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81975e9-79ac-417a-bc61-b1576e595eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a322c01-d912-4c04-a950-c9b74d62c665', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13dbd6a2-453c-4265-b2c8-216adaf279ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] Creating offline snapshot c949c0eb-ffce-400c-bd29-928256febdef of volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:25:28 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Volume volume-9a322c01-d912-4c04-a950-c9b74d62c665 (9a322c01-d912-4c04-a950-c9b74d62c665): created successfully Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13dbd6a2-453c-4265-b2c8-216adaf279ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (d01bc27c-035c-4184-accc-ab6de5c956c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b38a94-080b-4e40-855e-02ca8c1149d6]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:28 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-333536b9-e7c7-40c2-b570-ea02570302c8 tempest-VolumesGetTest-909272433 None] Created volume successfully. Jul 23 03:25:28 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:25:28 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:28 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.355s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:28 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef 1G Jul 23 03:25:28 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:29 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef 1G" returned: 0 in 0.460s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:29 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef Jul 23 03:25:29 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:29 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef" returned: 0 in 0.346s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:29 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef is being set with open permissions: ugo+rw Jul 23 03:25:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:29 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef Jul 23 03:25:29 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:29 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef" returned: 0 in 0.309s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.615s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.246s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] Creating offline snapshot 65c96996-5bd6-4484-9ce0-6d0f0f09b362 of volume 43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:25:29 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-16cd8d11-9821-41e1-ad0f-0261aed0f470 tempest-SnapshotsActionsTest-1954076103 None] Create snapshot completed successfully Jul 23 03:25:29 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091171d-d931-4a92-a744-15bdb0e75f15]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:30 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 Jul 23 03:25:30 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (79b5723c-ed08-4319-8474-bd0709ce4d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539c9b03-1b3b-411a-a506-bd6732c78678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539c9b03-1b3b-411a-a506-bd6732c78678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-228851947',display_name='tempest-VolumesGetTest-Volume-2026790306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a996e94-a83b-4bd1-aa16-ff633c4cc5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:30Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c430caa-f90a-4136-bda5-6e5a8e92407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c430caa-f90a-4136-bda5-6e5a8e92407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc3a8eb-b0ce-4dc6-b171-5bac3f952d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc3a8eb-b0ce-4dc6-b171-5bac3f952d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a996e94-a83b-4bd1-aa16-ff633c4cc5e9', 'volume_name': 'volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efae9998-edb0-4c1f-bb00-cc54bafc9e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efae9998-edb0-4c1f-bb00-cc54bafc9e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cf1b91-57a8-46c8-88fd-47815eef2fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:30 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Volume 2a996e94-a83b-4bd1-aa16-ff633c4cc5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9', 'volume_size': 1} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:30 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48" returned: 0 in 0.498s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:30 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 1G Jul 23 03:25:30 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-c949c0eb-ffce-400c-bd29-928256febdef-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-c949c0eb-ffce-400c-bd29-928256febdef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-quobyte-c949c0eb-ffce-400c-bd29-928256febdef" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-c949c0eb-ffce-400c-bd29-928256febdef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Deleting offline snapshot c949c0eb-ffce-400c-bd29-928256febdef of volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] snapshot_file for this snap is: volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44dd73a-d71b-42f3-8e5d-8efa31c572cb]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:30 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef Jul 23 03:25:30 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:30 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 1G" returned: 0 in 0.507s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43de597e-ab6d-45bc-8358-2fe859821c48 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:30 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43de597e-ab6d-45bc-8358-2fe859821c48 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 Jul 23 03:25:30 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:31 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef" returned: 0 in 0.424s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4635dda-fa55-49da-b0d3-841efba4f955]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:31 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43de597e-ab6d-45bc-8358-2fe859821c48 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362" returned: 0 in 0.339s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:31 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 is being set with open permissions: ugo+rw Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:31 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 Jul 23 03:25:31 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:31 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:25:31 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:31 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362" returned: 0 in 0.250s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:31 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.386s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:31 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.info Jul 23 03:25:31 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:31 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef Jul 23 03:25:31 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:31 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.info" returned: 0 in 0.264s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:31 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.info is being set with open permissions: ugo+rw Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:31 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.info Jul 23 03:25:31 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:31 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef" returned: 0 in 0.428s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:32 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef Jul 23 03:25:32 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:32 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.info" returned: 0 in 0.261s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.757s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-228851947',display_name='tempest-VolumesGetTest-Volume-2026790306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a996e94-a83b-4bd1-aa16-ff633c4cc5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:30Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Creating volume 2a996e94-a83b-4bd1-aa16-ff633c4cc5e9 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:32 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:32 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9 1073741824 Jul 23 03:25:32 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:32 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-83cd7cf4-244d-4d8d-aef9-ac2235f30604 tempest-VolumesSnapshotListTestJSON-588420697 None] Create snapshot completed successfully Jul 23 03:25:32 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.c949c0eb-ffce-400c-bd29-928256febdef" returned: 0 in 0.269s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-c949c0eb-ffce-400c-bd29-928256febdef" released by "_delete_snapshot" :: held 1.637s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" released by "delete_snapshot" :: held 1.665s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Created reservations ['4d2ad789-23af-4616-bcfe-4c61cd656a16', '65877c56-af51-4deb-9496-c704e805c684', '123c32c0-a82e-4322-ba02-7cd926e71ec2', '3348f8e1-e5c3-498e-a08a-3558efc3c0c3'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:32 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Delete snapshot completed successfully. Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d34a8121-0997-4e6f-8ed4-501e69e75880 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-c949c0eb-ffce-400c-bd29-928256febdef-delete_snapshot" released by "delete_snapshot" :: held 1.838s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:32 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9 1073741824" returned: 0 in 0.515s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:32 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9 Jul 23 03:25:32 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:33 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9" returned: 0 in 0.400s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cf1b91-57a8-46c8-88fd-47815eef2fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b3ff7a-9230-4718-a7b0-18701ad89dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:33 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Volume volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9 (2a996e94-a83b-4bd1-aa16-ff633c4cc5e9): created successfully Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b3ff7a-9230-4718-a7b0-18701ad89dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (79b5723c-ed08-4319-8474-bd0709ce4d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:33 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b314355e-756f-4152-8ec6-7945b9e422c3 tempest-VolumesGetTest-909272433 None] Created volume successfully. Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] Creating offline snapshot f32e20ef-d523-4fb7-8409-9d9012a6805c of volume 43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5b8538-9d03-4717-852e-e6bcc27fcfcb]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:33 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 Jul 23 03:25:33 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Lock "cinder-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-quobyte-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[63329c96-2d42-4fac-80f0-b6774e2f4257]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:33 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362" returned: 0 in 0.462s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43de597e-ab6d-45bc-8358-2fe859821c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:33 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c 1G Jul 23 03:25:33 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:33 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9 Jul 23 03:25:33 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:34 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9" returned: 0 in 0.377s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:34 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9 Jul 23 03:25:34 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:34 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c 1G" returned: 0 in 0.502s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:34 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c Jul 23 03:25:34 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:34 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9" returned: 0 in 0.285s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9" released by "delete_volume" :: held 0.707s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Created reservations ['790326f0-dcf3-452f-a1fc-04dee995b3f8', 'e841a554-df0f-44ce-8bf1-fb273325aa38', '9ad3653d-aec1-4535-8989-38a2705343a8', '4041693b-7df7-4c20-9525-78684fe3d05a'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:34 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:34 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:34 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c" returned: 0 in 0.356s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:34 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c is being set with open permissions: ugo+rw Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:34 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c Jul 23 03:25:34 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-9a322c01-d912-4c04-a950-c9b74d62c665-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:34 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Lock "cinder-9a322c01-d912-4c04-a950-c9b74d62c665-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.321s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:34 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Deleted volume successfully. Jul 23 03:25:34 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c" returned: 0 in 0.282s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-12a8191b-4b3d-4326-a5f2-272baf61d493 tempest-VolumesGetTest-909272433 None] Lock "cinder-2a996e94-a83b-4bd1-aa16-ff633c4cc5e9-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-quobyte-9a322c01-d912-4c04-a950-c9b74d62c665" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.737s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.640s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-9a322c01-d912-4c04-a950-c9b74d62c665" acquired by "delete_volume" :: waited 0.045s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] Creating offline snapshot 99c6214d-2829-48d5-b790-7cf92c341d6b of volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[39419cc2-9e4b-4c9d-b829-19006cbc8626]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:34 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-58b74747-bac6-424b-8660-89b6426f4f71 tempest-VolumesSnapshotListTestJSON-588420697 None] Create snapshot completed successfully Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28e8b28-2f58-422a-a23f-2ca864b2f2ec]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:35 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665 Jul 23 03:25:35 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:35 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:25:35 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:35 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:35 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665" returned: 0 in 0.466s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.453s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:35 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665 Jul 23 03:25:35 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:35 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b 1G Jul 23 03:25:35 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:35 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9a322c01-d912-4c04-a950-c9b74d62c665" returned: 0 in 0.288s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-9a322c01-d912-4c04-a950-c9b74d62c665" released by "delete_volume" :: held 0.842s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Created reservations ['23d82056-7c06-4db2-b136-f2994282e89b', '5aaf23d1-368e-4b40-9530-cbb677875535', '1361470b-ba3f-42d6-88a5-b5ae7eba89b7', '87d2557d-d571-460b-878f-be3ce1820875'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:35 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:35 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:36 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b 1G" returned: 0 in 0.600s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:36 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b Jul 23 03:25:36 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:36 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.360s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Deleted volume successfully. Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b99d1aa5-c29c-4f75-b177-f96388165d4d tempest-VolumesGetTest-909272433 None] Lock "cinder-9a322c01-d912-4c04-a950-c9b74d62c665-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:36 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b" returned: 0 in 0.417s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:36 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b is being set with open permissions: ugo+rw Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:36 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b Jul 23 03:25:36 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (730bbe45-c7d6-4bbf-8577-53524c8cf102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084bbc7b-a836-47f9-9c4d-f9946e280d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084bbc7b-a836-47f9-9c4d-f9946e280d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-748869631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6d24e3-2697-4460-aec6-4217ba49304b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:37Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2912f79d-bb82-4658-b8c6-83979e9fede4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2912f79d-bb82-4658-b8c6-83979e9fede4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad790a0-8abb-4edd-a774-89ce842e2b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad790a0-8abb-4edd-a774-89ce842e2b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6d24e3-2697-4460-aec6-4217ba49304b', 'volume_name': 'volume-0b6d24e3-2697-4460-aec6-4217ba49304b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268c8f0d-8135-415e-948c-dd0edde943a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268c8f0d-8135-415e-948c-dd0edde943a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8132d75f-50f5-4125-a96b-900896d1af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:36 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Volume 0b6d24e3-2697-4460-aec6-4217ba49304b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6d24e3-2697-4460-aec6-4217ba49304b', 'volume_size': 1} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:36 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b" returned: 0 in 0.276s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.880s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.345s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] Creating offline snapshot af2f6acc-3766-4607-af76-bdaaaed6cd0a of volume 43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:25:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ff44dd52-c2fe-4e24-a352-2647af368514 tempest-SnapshotsActionsTest-1954076103 None] Create snapshot completed successfully Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb624db-126a-43b8-971a-2a689ed01e09]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:36 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c Jul 23 03:25:36 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:37 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c" returned: 0 in 0.390s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43de597e-ab6d-45bc-8358-2fe859821c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:37 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a 1G Jul 23 03:25:37 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-99c6214d-2829-48d5-b790-7cf92c341d6b-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-99c6214d-2829-48d5-b790-7cf92c341d6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-quobyte-99c6214d-2829-48d5-b790-7cf92c341d6b" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-99c6214d-2829-48d5-b790-7cf92c341d6b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Deleting offline snapshot 99c6214d-2829-48d5-b790-7cf92c341d6b of volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] snapshot_file for this snap is: volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c2170b-9f9e-4ef7-ba1d-33c913155a82]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:37 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b Jul 23 03:25:37 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:37 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a 1G" returned: 0 in 0.602s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:37 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a Jul 23 03:25:37 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b" returned: 0 in 0.411s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1eaf24-c0e1-4737-bfcc-a377c67743be]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:38 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a" returned: 0 in 0.362s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a is being set with open permissions: ugo+rw Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:38 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a Jul 23 03:25:38 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:25:38 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.727s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.778s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-748869631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6d24e3-2697-4460-aec6-4217ba49304b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:37Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Creating volume 0b6d24e3-2697-4460-aec6-4217ba49304b {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:38 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:38 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.445s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:38 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b 1073741824 Jul 23 03:25:38 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:38 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2592d645-17e4-4672-b367-6a7bbc97aaf5 tempest-VolumesSnapshotListTestJSON-588420697 None] Create snapshot completed successfully Jul 23 03:25:38 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b Jul 23 03:25:38 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:39 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b 1073741824" returned: 0 in 0.448s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:39 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b" returned: 0 in 0.479s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:39 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b Jul 23 03:25:39 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:39 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b Jul 23 03:25:39 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Flow 'volume_create_manager' (62aae7f0-10c0-4173-89bc-f60b2302049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b368806b-a7d3-4981-9fc4-b10146673dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:39 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b368806b-a7d3-4981-9fc4-b10146673dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-542093703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2ea2ad-896b-45f0-bcf8-5c6817561c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbafb48f399f49b6becf5dcb912b6633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:39Z,use_quota=True,user_id='7f9daf99306e4739ba6cb403e649bddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:39 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb60c86-e3e9-4154-b5ce-f821b476a273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb60c86-e3e9-4154-b5ce-f821b476a273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e00ffe9-6966-419a-868c-a7694326e138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e00ffe9-6966-419a-868c-a7694326e138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2ea2ad-896b-45f0-bcf8-5c6817561c0b', 'volume_name': 'volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d22f548-4bef-4769-aeb8-b0811beca20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d22f548-4bef-4769-aeb8-b0811beca20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0298ae5-bfd2-4013-b43e-1b7663fe9790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Volume 4f2ea2ad-896b-45f0-bcf8-5c6817561c0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b', 'volume_size': 1} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.99c6214d-2829-48d5-b790-7cf92c341d6b" returned: 0 in 0.318s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b" returned: 0 in 0.329s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-542093703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2ea2ad-896b-45f0-bcf8-5c6817561c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbafb48f399f49b6becf5dcb912b6633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:39Z,use_quota=True,user_id='7f9daf99306e4739ba6cb403e649bddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Creating volume 4f2ea2ad-896b-45f0-bcf8-5c6817561c0b {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:39 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-99c6214d-2829-48d5-b790-7cf92c341d6b" released by "_delete_snapshot" :: held 1.770s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:39 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b 1073741824 Jul 23 03:25:39 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8132d75f-50f5-4125-a96b-900896d1af4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6d24e3-2697-4460-aec6-4217ba49304b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06ce6c8-fc33-4523-b8e9-e6f07dfb8a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" released by "delete_snapshot" :: held 1.808s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Volume volume-0b6d24e3-2697-4460-aec6-4217ba49304b (0b6d24e3-2697-4460-aec6-4217ba49304b): created successfully Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06ce6c8-fc33-4523-b8e9-e6f07dfb8a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (730bbe45-c7d6-4bbf-8577-53524c8cf102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4ba8857b-553b-482d-962d-7156c19db84d tempest-VolumesGetTest-909272433 None] Created volume successfully. Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Created reservations ['6e4ae615-1bd7-4bd0-8fa9-2d2f8d55dcc9', '66909805-17cd-4e54-a57c-fe1c1b5873d2', '1ff0ba4e-c652-4b3d-906e-d271ea04851f', '1f04bbdd-1922-46e7-b6f7-e4a6523e2329'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Delete snapshot completed successfully. Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-664ad0d6-70ef-4f0a-827b-8305bc3b8c63 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-99c6214d-2829-48d5-b790-7cf92c341d6b-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:39 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b 1073741824" returned: 0 in 0.492s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:39 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b Jul 23 03:25:39 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:40 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b" returned: 0 in 0.317s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0298ae5-bfd2-4013-b43e-1b7663fe9790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe9b8c5-19fd-4870-9d3a-3d843e70d20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Volume volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b (4f2ea2ad-896b-45f0-bcf8-5c6817561c0b): created successfully Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe9b8c5-19fd-4870-9d3a-3d843e70d20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Flow 'volume_create_manager' (62aae7f0-10c0-4173-89bc-f60b2302049e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] Creating offline snapshot 23528fc8-1f54-4d86-b067-23489b011f77 of volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:25:40 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-744c571c-1ecc-40a5-bc3e-e504d0d5e1fd tempest-AbsoluteLimitsTests-949932592 None] Created volume successfully. Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9211d48c-5e83-4a39-939f-c0d13ca0a7a2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (e43481da-65d6-433e-a034-b8b60d793fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50821f91-b43a-4514-aa1b-54843ed84eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:25:40 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50821f91-b43a-4514-aa1b-54843ed84eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-867668066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1266996e-ac44-4587-9940-0ba6d779ec2c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0b6d24e3-2697-4460-aec6-4217ba49304b,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:40Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61c8857-6f3e-43cc-b28a-7015b6191f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61c8857-6f3e-43cc-b28a-7015b6191f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7690766e-f65a-44cc-a8d3-fe50a2c78630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7690766e-f65a-44cc-a8d3-fe50a2c78630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1266996e-ac44-4587-9940-0ba6d779ec2c', 'volume_name': 'volume-1266996e-ac44-4587-9940-0ba6d779ec2c', 'volume_size': 1, 'source_volid': '0b6d24e3-2697-4460-aec6-4217ba49304b', 'source_volstatus': 'available'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539bf5cd-ffcf-4e3f-be8c-48a75efa58df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539bf5cd-ffcf-4e3f-be8c-48a75efa58df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8b065e-e50c-4202-8f33-17904532979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Volume 1266996e-ac44-4587-9940-0ba6d779ec2c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1266996e-ac44-4587-9940-0ba6d779ec2c', 'volume_size': 1, 'source_volid': '0b6d24e3-2697-4460-aec6-4217ba49304b', 'source_volstatus': 'available'} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "cinder-af2f6acc-3766-4607-af76-bdaaaed6cd0a-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-af2f6acc-3766-4607-af76-bdaaaed6cd0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "cinder-quobyte-af2f6acc-3766-4607-af76-bdaaaed6cd0a" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-af2f6acc-3766-4607-af76-bdaaaed6cd0a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Deleting offline snapshot af2f6acc-3766-4607-af76-bdaaaed6cd0a of volume 43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] snapshot_file for this snap is: volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacceaf8-6e64-4379-82e4-8ef428696aba]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:40 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.488s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:40 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 1G Jul 23 03:25:40 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:41 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a Jul 23 03:25:41 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:41 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a" returned: 0 in 0.394s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43de597e-ab6d-45bc-8358-2fe859821c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7db235-e7bf-4a59-8fad-c56def71aba6]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:41 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 1G" returned: 0 in 0.449s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:41 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 Jul 23 03:25:41 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:41 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c Jul 23 03:25:41 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Acquiring lock "cinder-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Lock "cinder-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Acquiring lock "cinder-quobyte-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Lock "cinder-quobyte-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe5e361-297c-4fe4-aafe-38d79615c6be]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:41 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77" returned: 0 in 0.350s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:41 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 is being set with open permissions: ugo+rw Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:41 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 Jul 23 03:25:41 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:41 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c" returned: 0 in 0.418s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43de597e-ab6d-45bc-8358-2fe859821c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:41 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a Jul 23 03:25:41 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:41 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b Jul 23 03:25:41 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:41 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.686s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.365s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:42 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Cloning volume 0b6d24e3-2697-4460-aec6-4217ba49304b to volume 1266996e-ac44-4587-9940-0ba6d779ec2c Jul 23 03:25:42 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f8f37105-4611-4371-b1ab-d262fa431fbb tempest-SnapshotsActionsTest-1954076103 None] Create snapshot completed successfully Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b" returned: 0 in 0.395s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Creating offline snapshot f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa of volume 0b6d24e3-2697-4460-aec6-4217ba49304b {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:25:42 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b Jul 23 03:25:42 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb4628b-38c3-47a8-845e-c5d063ea1baa]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:42 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a" returned: 0 in 0.434s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:42 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a Jul 23 03:25:42 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:42 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b Jul 23 03:25:42 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:42 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b" returned: 0 in 0.286s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Lock "cinder-quobyte-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b" released by "delete_volume" :: held 0.732s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Created reservations ['a4bcaf29-89bc-4422-b1f9-c0a9651ab073', 'a9385dae-a0d9-4e20-9a03-067967a8c59e', 'cf39c204-c537-4652-a635-826b2254c967', 'f61d3383-1bcb-4e46-9ed3-a65d637565c1'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:42 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.af2f6acc-3766-4607-af76-bdaaaed6cd0a" returned: 0 in 0.297s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:42 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-af2f6acc-3766-4607-af76-bdaaaed6cd0a" released by "_delete_snapshot" :: held 1.660s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b" returned: 0 in 0.439s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" released by "delete_snapshot" :: held 1.703s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-23528fc8-1f54-4d86-b067-23489b011f77-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:42 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa 1G Jul 23 03:25:42 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-23528fc8-1f54-4d86-b067-23489b011f77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-quobyte-23528fc8-1f54-4d86-b067-23489b011f77" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-23528fc8-1f54-4d86-b067-23489b011f77" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Deleting offline snapshot 23528fc8-1f54-4d86-b067-23489b011f77 of volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:25:42 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:42 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] snapshot_file for this snap is: volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[027236dd-8c1a-4436-a35b-7ea136e71a45]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Created reservations ['edad3c27-8e9e-445c-8343-8532858725f4', 'be962a5e-2002-4e86-8bea-9bf9dbcc2839', 'e359d120-23a5-429c-9adc-f766b1620136', 'ee8e1cc9-bf3a-4606-970e-4febe9d5453c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Delete snapshot completed successfully. Jul 23 03:25:42 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 Jul 23 03:25:42 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0183eaef-45b6-4445-8f29-e38bf86b3473 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-af2f6acc-3766-4607-af76-bdaaaed6cd0a-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:42 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.291s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:42 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Deleted volume successfully. Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5b8dbcb8-e870-4e7f-9c8b-879fe894f991 tempest-AbsoluteLimitsTests-949932592 None] Lock "cinder-4f2ea2ad-896b-45f0-bcf8-5c6817561c0b-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "cinder-f32e20ef-d523-4fb7-8409-9d9012a6805c-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-f32e20ef-d523-4fb7-8409-9d9012a6805c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "cinder-quobyte-f32e20ef-d523-4fb7-8409-9d9012a6805c" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-f32e20ef-d523-4fb7-8409-9d9012a6805c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Deleting offline snapshot f32e20ef-d523-4fb7-8409-9d9012a6805c of volume 43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:25:43 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] snapshot_file for this snap is: volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa 1G" returned: 0 in 0.664s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6d24e3-2697-4460-aec6-4217ba49304b -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f4d714-0a35-4aef-b9f9-e3399fef17b6]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6d24e3-2697-4460-aec6-4217ba49304b -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa Jul 23 03:25:43 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:43 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77" returned: 0 in 0.525s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca185d57-003a-4e8d-ba54-ca881d24704a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c Jul 23 03:25:43 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:43 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:25:43 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:43 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6d24e3-2697-4460-aec6-4217ba49304b -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa" returned: 0 in 0.346s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:43 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa is being set with open permissions: ugo+rw Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa Jul 23 03:25:43 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:43 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c" returned: 0 in 0.466s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43de597e-ab6d-45bc-8358-2fe859821c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[41976dcb-8056-4cd9-90cd-018a14820618]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.447s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 Jul 23 03:25:43 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:43 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 Jul 23 03:25:43 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:43 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa" returned: 0 in 0.288s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:43 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.info Jul 23 03:25:43 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:44 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362" returned: 0 in 0.407s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43de597e-ab6d-45bc-8358-2fe859821c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:44 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c Jul 23 03:25:44 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:44 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:44 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.info" returned: 0 in 0.356s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77" returned: 0 in 0.503s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:44 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.info is being set with open permissions: ugo+rw Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:44 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.info Jul 23 03:25:44 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:44 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77 Jul 23 03:25:44 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:44 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.info" returned: 0 in 0.278s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:44 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-quobyte-1266996e-ac44-4587-9940-0ba6d779ec2c" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.23528fc8-1f54-4d86-b067-23489b011f77" returned: 0 in 0.299s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:44 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c" returned: 0 in 0.447s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-1266996e-ac44-4587-9940-0ba6d779ec2c" acquired by "_copy_volume_from_snapshot" :: waited 0.061s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] snapshot: f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa, volume: 1266996e-ac44-4587-9940-0ba6d779ec2c, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:25:44 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c Jul 23 03:25:44 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-23528fc8-1f54-4d86-b067-23489b011f77" released by "_delete_snapshot" :: held 1.977s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" released by "delete_snapshot" :: held 2.029s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[82872dab-452b-4273-aa7b-5155f7a4e3cb]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Created reservations ['663a6412-f118-4e6e-b8a6-780345a410ae', '6cd9f698-a582-4e69-bebf-afb7a69d3610', '0e437652-f9f5-4086-ada5-8b470616e7c6', '3a6ecfb1-6b08-4842-9289-2039fd32af9c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Delete snapshot completed successfully. Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36e3308d-7a4b-4cf4-a59c-52f80a36fa4d tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-23528fc8-1f54-4d86-b067-23489b011f77-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:44 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa Jul 23 03:25:44 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:44 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.f32e20ef-d523-4fb7-8409-9d9012a6805c" returned: 0 in 0.302s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-f32e20ef-d523-4fb7-8409-9d9012a6805c" released by "_delete_snapshot" :: held 1.734s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" released by "delete_snapshot" :: held 1.757s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Created reservations ['5b3e2aad-9008-4297-8ae5-c78f1781eccf', '6c2ee084-fd75-4ffc-b973-601a6bdb5613', 'd84da2cb-40cc-43f0-a4db-a086f8f33c31', 'dfcc09d1-ab19-4150-91b8-4a3d1ed7e33e'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Delete snapshot completed successfully. Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6bd5b700-4015-44cf-9eed-f084a1c6113b tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-f32e20ef-d523-4fb7-8409-9d9012a6805c-delete_snapshot" released by "delete_snapshot" :: held 1.952s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:45 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa" returned: 0 in 0.459s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b6d24e3-2697-4460-aec6-4217ba49304b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c73081f-b78e-4919-8dd1-2d2c93674c2d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:45 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b Jul 23 03:25:45 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "cinder-65c96996-5bd6-4484-9ce0-6d0f0f09b362-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-65c96996-5bd6-4484-9ce0-6d0f0f09b362-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "cinder-quobyte-65c96996-5bd6-4484-9ce0-6d0f0f09b362" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-65c96996-5bd6-4484-9ce0-6d0f0f09b362" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Deleting offline snapshot 65c96996-5bd6-4484-9ce0-6d0f0f09b362 of volume 43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] snapshot_file for this snap is: volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ce0ba2-6c56-4095-8d23-0d152407e64a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:45 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 Jul 23 03:25:45 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:45 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b" returned: 0 in 0.428s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:45 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c Jul 23 03:25:45 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:45 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362" returned: 0 in 0.426s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43de597e-ab6d-45bc-8358-2fe859821c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e635bb4-52e8-4b23-9a38-a6063b3b114d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:46 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 Jul 23 03:25:46 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:46 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48" returned: 0 in 0.587s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:46 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 Jul 23 03:25:46 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:47 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362" returned: 0 in 0.992s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:47 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362 Jul 23 03:25:47 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:48 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48.65c96996-5bd6-4484-9ce0-6d0f0f09b362" returned: 0 in 0.563s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-65c96996-5bd6-4484-9ce0-6d0f0f09b362" released by "_delete_snapshot" :: held 2.823s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" released by "delete_snapshot" :: held 2.882s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:48 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Created reservations ['a702d69e-21c6-4010-ac8f-a996c83a9513', '1cabe946-94bd-4d10-87e1-6958cd89c0aa', '8a1b24da-2214-40e5-b97b-7a43ac831c29', 'd3fe9061-feba-47dd-9660-d13f914f0841'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:48 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Delete snapshot completed successfully. Jul 23 03:25:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-555c05f4-1ed3-442b-898d-cfb7ba07c28a tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-65c96996-5bd6-4484-9ce0-6d0f0f09b362-delete_snapshot" released by "delete_snapshot" :: held 3.192s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "cinder-43de597e-ab6d-45bc-8358-2fe859821c48-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-43de597e-ab6d-45bc-8358-2fe859821c48-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cbb395-953a-4780-976b-dca4be6487e2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:49 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 Jul 23 03:25:49 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Flow 'volume_create_manager' (68720ad1-4f36-4bbd-ae51-b650cfa25379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7649344f-56bf-4236-9db0-51a53fec7fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7649344f-56bf-4236-9db0-51a53fec7fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-612999362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9fca61-201f-469f-a832-edb3c3d384a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feda33857d824f0aa703e36d4e76f6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:49Z,use_quota=True,user_id='a57c80f913d042d68ab108d97bbc7498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908bdf31-a280-4d05-8841-505ddf88731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908bdf31-a280-4d05-8841-505ddf88731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb10dff6-a3ad-41e8-bff9-b9a2a360c5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb10dff6-a3ad-41e8-bff9-b9a2a360c5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9fca61-201f-469f-a832-edb3c3d384a8', 'volume_name': 'volume-9d9fca61-201f-469f-a832-edb3c3d384a8', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7dfe74-568f-4e43-ac70-9df4a84de057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7dfe74-568f-4e43-ac70-9df4a84de057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89c7a17-5ca3-405f-9163-cb1368ea7b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:49 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Volume 9d9fca61-201f-469f-a832-edb3c3d384a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9fca61-201f-469f-a832-edb3c3d384a8', 'volume_size': 1} Jul 23 03:25:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:50 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48" returned: 0 in 1.076s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:50 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48 Jul 23 03:25:50 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:50 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-43de597e-ab6d-45bc-8358-2fe859821c48" returned: 0 in 0.458s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-quobyte-43de597e-ab6d-45bc-8358-2fe859821c48" released by "delete_volume" :: held 1.731s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Created reservations ['8cd6501e-c846-4acd-b472-6808d4eacc65', 'd3c83cb8-43ad-49d5-aa27-18250f65b0db', '178ccb07-b164-4d4c-8c83-f51372bcbf6d', 'c5028044-85d8-4a79-9e6e-ea52c6187dc6'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:50 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c" returned: 0 in 5.170s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f60878-31fe-47fb-8e6d-dabf58e98ffc]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:50 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:50 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:50 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b Jul 23 03:25:50 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:51 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.237s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:51 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Deleted volume successfully. Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f9995c39-84ce-4f2f-adf0-047267406cc5 tempest-VolumesSnapshotListTestJSON-588420697 None] Lock "cinder-43de597e-ab6d-45bc-8358-2fe859821c48-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:51 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b" returned: 0 in 0.525s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b, size 1024.00 MB, duration 5.17 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:25:51 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Converted 1024.00 MB image at 198.04 MB/s Jul 23 03:25:51 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c is being set with open permissions: ugo+rw Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:51 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c Jul 23 03:25:51 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:51 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c" returned: 0 in 0.254s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-1266996e-ac44-4587-9940-0ba6d779ec2c" released by "_copy_volume_from_snapshot" :: held 6.949s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-quobyte-f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Deleting offline snapshot f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa of volume 0b6d24e3-2697-4460-aec6-4217ba49304b {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] snapshot_file for this snap is: volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[572e0724-8e29-40e5-a2ad-e7388194e463]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:51 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa Jul 23 03:25:51 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:51 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa" returned: 0 in 0.363s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b6d24e3-2697-4460-aec6-4217ba49304b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:52 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8a205e-73b3-4945-847e-b8dd529a39ea]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:52 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b Jul 23 03:25:52 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:52 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b" returned: 0 in 0.385s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:52 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa Jul 23 03:25:52 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:52 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa" returned: 0 in 0.421s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:52 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa Jul 23 03:25:52 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:53 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b.f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa" returned: 0 in 0.245s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-f4e33a68-3d87-42bc-93ea-d76e6b7c1dfa" released by "_delete_snapshot" :: held 1.519s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.120s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.969s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8b065e-e50c-4202-8f33-17904532979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1266996e-ac44-4587-9940-0ba6d779ec2c', 'volume_size': 1, 'source_volid': '0b6d24e3-2697-4460-aec6-4217ba49304b', 'source_volstatus': 'available'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3d11fa-1e77-47d6-b1c4-957c195ec237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] Creating offline snapshot 2e60548b-42de-4340-9a6c-8405f4aa588c of volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:25:53 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Volume volume-1266996e-ac44-4587-9940-0ba6d779ec2c (1266996e-ac44-4587-9940-0ba6d779ec2c): created successfully Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3d11fa-1e77-47d6-b1c4-957c195ec237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (e43481da-65d6-433e-a034-b8b60d793fc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f75ce8-827b-4c51-b8ae-3a43e6f9d83f]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:53 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-69b89440-9a44-4dfc-85ae-b0ecb18f0943 tempest-VolumesGetTest-909272433 None] Created volume successfully. Jul 23 03:25:53 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:25:53 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:53 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.382s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:53 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c 1G Jul 23 03:25:53 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:54 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c 1G" returned: 0 in 0.522s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:54 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c Jul 23 03:25:54 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:54 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c" returned: 0 in 0.400s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:54 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c is being set with open permissions: ugo+rw Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:54 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c Jul 23 03:25:54 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (9d0c4c7b-5902-4074-a133-6eaadc255adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912c5bac-4f19-4de5-a587-aa9e2b23af65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912c5bac-4f19-4de5-a587-aa9e2b23af65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-886294446',display_name='tempest-VolumesGetTest-Volume-1533971053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88966367-1e99-4b47-b5c7-43e4e6b83f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:55Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35ba2ca-4156-4325-b2a3-83a22e54e5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a35ba2ca-4156-4325-b2a3-83a22e54e5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75fccc7-2b60-407a-8579-3f2c158ff8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75fccc7-2b60-407a-8579-3f2c158ff8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88966367-1e99-4b47-b5c7-43e4e6b83f84', 'volume_name': 'volume-88966367-1e99-4b47-b5c7-43e4e6b83f84', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960347bb-cf67-4f4b-8687-67650170115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960347bb-cf67-4f4b-8687-67650170115c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d965b000-370d-4ab6-a9cc-ab55e1755e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:54 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Volume 88966367-1e99-4b47-b5c7-43e4e6b83f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88966367-1e99-4b47-b5c7-43e4e6b83f84', 'volume_size': 1} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:54 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c" returned: 0 in 0.248s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.709s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.294s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-612999362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9fca61-201f-469f-a832-edb3c3d384a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feda33857d824f0aa703e36d4e76f6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:49Z,use_quota=True,user_id='a57c80f913d042d68ab108d97bbc7498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Creating volume 9d9fca61-201f-469f-a832-edb3c3d384a8 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:54 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:54 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8 1073741824 Jul 23 03:25:54 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:54 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d2b06889-bd71-4911-9ad7-4ac57f086adc tempest-SnapshotsActionsTest-1954076103 None] Create snapshot completed successfully Jul 23 03:25:55 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8 1073741824" returned: 0 in 0.495s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:55 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8 Jul 23 03:25:55 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:55 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8" returned: 0 in 0.263s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:25:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-886294446',display_name='tempest-VolumesGetTest-Volume-1533971053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88966367-1e99-4b47-b5c7-43e4e6b83f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:25:55Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Creating volume 88966367-1e99-4b47-b5c7-43e4e6b83f84 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:25:55 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89c7a17-5ca3-405f-9163-cb1368ea7b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9fca61-201f-469f-a832-edb3c3d384a8', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151de291-94cc-43a0-afce-cb2ba5aacb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:55 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84 1073741824 Jul 23 03:25:55 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:55 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Volume volume-9d9fca61-201f-469f-a832-edb3c3d384a8 (9d9fca61-201f-469f-a832-edb3c3d384a8): created successfully Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151de291-94cc-43a0-afce-cb2ba5aacb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Flow 'volume_create_manager' (68720ad1-4f36-4bbd-ae51-b650cfa25379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:55 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-918674e2-95fb-420d-a8f2-c7c69ab75f83 tempest-VolumesMetadataTest-1538218841 None] Created volume successfully. Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-2e60548b-42de-4340-9a6c-8405f4aa588c-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-2e60548b-42de-4340-9a6c-8405f4aa588c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Acquiring lock "cinder-quobyte-2e60548b-42de-4340-9a6c-8405f4aa588c" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-2e60548b-42de-4340-9a6c-8405f4aa588c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Deleting offline snapshot 2e60548b-42de-4340-9a6c-8405f4aa588c of volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] snapshot_file for this snap is: volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[877cb419-9d7c-4f1f-9bd9-d2063756a514]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:56 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c Jul 23 03:25:56 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:56 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84 1073741824" returned: 0 in 0.583s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:56 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84 Jul 23 03:25:56 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:56 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c" returned: 0 in 0.450s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a3542a-560d-41bd-9ea4-03313bd094f8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:56 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:25:56 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:56 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84" returned: 0 in 0.377s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d965b000-370d-4ab6-a9cc-ab55e1755e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88966367-1e99-4b47-b5c7-43e4e6b83f84', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ab31ca-f7ad-42c6-9293-70ca9cbc56b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:25:56 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Volume volume-88966367-1e99-4b47-b5c7-43e4e6b83f84 (88966367-1e99-4b47-b5c7-43e4e6b83f84): created successfully Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ab31ca-f7ad-42c6-9293-70ca9cbc56b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (9d0c4c7b-5902-4074-a133-6eaadc255adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:25:56 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7fe7f5af-7c39-4e99-a1a8-3e2d54ac3c22 tempest-VolumesGetTest-909272433 None] Created volume successfully. Jul 23 03:25:56 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.453s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:25:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:57 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c Jul 23 03:25:57 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:57 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c" returned: 0 in 0.504s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:57 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c Jul 23 03:25:57 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Acquiring lock "cinder-9d9fca61-201f-469f-a832-edb3c3d384a8-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Lock "cinder-9d9fca61-201f-469f-a832-edb3c3d384a8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Acquiring lock "cinder-quobyte-9d9fca61-201f-469f-a832-edb3c3d384a8" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Lock "cinder-quobyte-9d9fca61-201f-469f-a832-edb3c3d384a8" acquired by "delete_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:57 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[872209c4-865d-4007-838e-5565fd57a9b7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:57 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8 Jul 23 03:25:57 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:57 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.2e60548b-42de-4340-9a6c-8405f4aa588c" returned: 0 in 0.442s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-2e60548b-42de-4340-9a6c-8405f4aa588c" released by "_delete_snapshot" :: held 2.014s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-88966367-1e99-4b47-b5c7-43e4e6b83f84-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" released by "delete_snapshot" :: held 2.058s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Lock "cinder-88966367-1e99-4b47-b5c7-43e4e6b83f84-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-quobyte-88966367-1e99-4b47-b5c7-43e4e6b83f84" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Created reservations ['e7f9c257-9a13-4f45-93c8-c389ca8132e8', 'cc547b33-c22c-4cde-8a09-a701e6065d8f', '598fd878-0843-48d1-9424-d5b1766b99cd', 'cec7b823-9114-47a1-8108-2752814aafe2'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-88966367-1e99-4b47-b5c7-43e4e6b83f84" acquired by "delete_volume" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b189db75-9a24-46c4-af98-719831b05bed]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:58 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8" returned: 0 in 0.515s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:58 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8 Jul 23 03:25:58 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:58 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Delete snapshot completed successfully. Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-744fd26c-df08-45c6-93d2-72ab38ff0ec6 tempest-SnapshotsActionsTest-1862269510 None] Lock "cinder-2e60548b-42de-4340-9a6c-8405f4aa588c-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:58 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84 Jul 23 03:25:58 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:58 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-9d9fca61-201f-469f-a832-edb3c3d384a8" returned: 0 in 0.263s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Lock "cinder-quobyte-9d9fca61-201f-469f-a832-edb3c3d384a8" released by "delete_volume" :: held 0.841s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Created reservations ['200aef7f-e33a-45dd-8ca6-f04782117ec8', 'be7eb8e1-452a-402b-847d-3b5ad0a782c5', '12a1f28f-82a7-4460-b052-3819adfdce7f', '0e0fd369-e00e-4ed5-ad1e-dd6b9f1097f9'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:58 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84" returned: 0 in 0.465s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:58 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:58 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:58 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84 Jul 23 03:25:58 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:59 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:59 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88966367-1e99-4b47-b5c7-43e4e6b83f84" returned: 0 in 0.373s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.412s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:59 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Deleted volume successfully. Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-88966367-1e99-4b47-b5c7-43e4e6b83f84" released by "delete_volume" :: held 0.949s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28e2c1a7-d5de-4111-a07d-04f5aff72128 tempest-VolumesMetadataTest-1538218841 None] Lock "cinder-9d9fca61-201f-469f-a832-edb3c3d384a8-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Created reservations ['b46eb54f-dcde-405d-a49b-a065b810b2dc', '1804df49-5129-4860-b4eb-330d0de2b85c', 'c5e2e389-9b85-4fed-a27d-2b08a7439e6b', 'a645783c-2ecc-40ae-9cf6-f66e1a1fa639'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:25:59 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:25:59 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:25:59 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.368s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:25:59 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Deleted volume successfully. Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "cinder-e36ef4df-7b6d-4fb4-934c-6fe96b524677-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2a461593-73ec-4639-9952-e24ac298b7e9 tempest-VolumesGetTest-909272433 None] Lock "cinder-88966367-1e99-4b47-b5c7-43e4e6b83f84-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Lock "cinder-e36ef4df-7b6d-4fb4-934c-6fe96b524677-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "cinder-quobyte-e36ef4df-7b6d-4fb4-934c-6fe96b524677" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Lock "cinder-quobyte-e36ef4df-7b6d-4fb4-934c-6fe96b524677" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Deleting offline snapshot e36ef4df-7b6d-4fb4-934c-6fe96b524677 of volume 7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] snapshot_file for this snap is: volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c219ee0-ffc4-4114-8b7d-a2d29bf73dcd]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:25:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:00 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:26:00 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:00 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.482s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-1266996e-ac44-4587-9940-0ba6d779ec2c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[380041b9-00ee-47c3-96be-cd0d6c941bf1]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Lock "cinder-1266996e-ac44-4587-9940-0ba6d779ec2c-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-quobyte-1266996e-ac44-4587-9940-0ba6d779ec2c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:00 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 Jul 23 03:26:00 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-1266996e-ac44-4587-9940-0ba6d779ec2c" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cd89af-69c3-4674-af12-d979d42761c0]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:00 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c Jul 23 03:26:00 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:00 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" returned: 0 in 0.465s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:01 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:26:01 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:01 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c" returned: 0 in 0.540s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:01 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c Jul 23 03:26:01 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:01 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.520s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:01 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677 Jul 23 03:26:01 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:01 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1266996e-ac44-4587-9940-0ba6d779ec2c" returned: 0 in 0.315s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-1266996e-ac44-4587-9940-0ba6d779ec2c" released by "delete_volume" :: held 0.925s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Created reservations ['b349bfe9-517b-4b91-ae36-4744ae6d2a15', '7838361b-04dd-4a33-a386-d45342b7073d', '46d07b2e-f574-4dfc-82ee-57f21e9f1f64', '594b8932-cdcf-4ebf-b422-d491efa6068b'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:01 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:01 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-0b6d24e3-2697-4460-aec6-4217ba49304b-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:01 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2.e36ef4df-7b6d-4fb4-934c-6fe96b524677" returned: 0 in 0.410s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Lock "cinder-0b6d24e3-2697-4460-aec6-4217ba49304b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Lock "cinder-quobyte-e36ef4df-7b6d-4fb4-934c-6fe96b524677" released by "_delete_snapshot" :: held 2.111s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" released by "delete_snapshot" :: held 2.143s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-quobyte-0b6d24e3-2697-4460-aec6-4217ba49304b" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-0b6d24e3-2697-4460-aec6-4217ba49304b" acquired by "delete_volume" :: waited 0.031s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:02 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.372s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[be835436-af0c-48e8-9275-111f1f732ae5]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:02 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Deleted volume successfully. Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Created reservations ['5cc9fcfe-cd54-400c-9859-1133ff1a7490', 'a1af14fa-5892-42a5-9946-9e26949923e2', 'aaca4de4-0508-4f6c-9941-f9db6227bfcd', '9ea7e6e5-4d6f-4654-baba-3e1f8c947d0c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ab0cdf2-470c-4f54-88c6-eef42b1de7c5 tempest-VolumesGetTest-909272433 None] Lock "cinder-1266996e-ac44-4587-9940-0ba6d779ec2c-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:02 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Delete snapshot completed successfully. Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ac9e6225-8d0c-484a-8940-e32c614191fe tempest-SnapshotsActionsTest-1954076103 None] Lock "cinder-e36ef4df-7b6d-4fb4-934c-6fe96b524677-delete_snapshot" released by "delete_snapshot" :: held 2.426s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:02 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b Jul 23 03:26:02 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:02 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b" returned: 0 in 0.448s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:02 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b Jul 23 03:26:02 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:02 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b6d24e3-2697-4460-aec6-4217ba49304b" returned: 0 in 0.301s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-0b6d24e3-2697-4460-aec6-4217ba49304b" released by "delete_volume" :: held 0.837s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Created reservations ['6c9f2454-1208-45d2-a604-409087bb0971', '465bf867-6090-42f9-9a24-ddfb6ae17791', '8f9034fd-4135-49c6-a9e6-bbdd1d2f0a93', '28e671c8-b3f0-4170-b9ab-4558bd1589e5'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:03 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:03 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "cinder-7c0c06c4-e63f-42cc-9beb-d7501a447dd2-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Lock "cinder-7c0c06c4-e63f-42cc-9beb-d7501a447dd2-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:03 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.302s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc94c7c8-690a-4cd0-aa3f-424f8d2db43c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:03 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Deleted volume successfully. Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a04e6513-26f3-4290-8f9b-7ded0c31ed6e tempest-VolumesGetTest-909272433 None] Lock "cinder-0b6d24e3-2697-4460-aec6-4217ba49304b-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:03 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 Jul 23 03:26:03 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:03 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" returned: 0 in 0.437s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:03 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2 Jul 23 03:26:03 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:04 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" returned: 0 in 0.311s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Lock "cinder-quobyte-7c0c06c4-e63f-42cc-9beb-d7501a447dd2" released by "delete_volume" :: held 0.839s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Created reservations ['acf9d0e3-98e9-4e82-a2cd-4e1993704f21', 'a761df5c-d06f-4b65-bad4-f2ecf39417fb', 'ff70b873-63d2-47eb-9fba-197d890b8560', '68191f04-8af2-4872-96e1-c9173e1c0b2f'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:04 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:04 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:04 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.295s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:04 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Deleted volume successfully. Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7d90ff74-8ba8-44ee-806f-b2d251682da1 tempest-SnapshotsActionsTest-1954076103 None] Lock "cinder-7c0c06c4-e63f-42cc-9beb-d7501a447dd2-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Flow 'volume_create_manager' (5bfa35a3-87cb-4745-8f53-337d47b40485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3acaddaf-1739-448b-a982-8aca470e313b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3acaddaf-1739-448b-a982-8aca470e313b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1686269485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b7e348-ac8d-4e20-8887-68f66a021845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb2aee0202145a58d644018046bc809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:05Z,use_quota=True,user_id='29dc43cf39d740979a537c12ddb74e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f221d7-5516-4086-9b2c-78efa226da6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f221d7-5516-4086-9b2c-78efa226da6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9930baf3-7c7a-4ea4-94bb-e042efddce0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9930baf3-7c7a-4ea4-94bb-e042efddce0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b7e348-ac8d-4e20-8887-68f66a021845', 'volume_name': 'volume-31b7e348-ac8d-4e20-8887-68f66a021845', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddc6312-5437-42cd-af8e-e27eb1c4773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddc6312-5437-42cd-af8e-e27eb1c4773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf77808-4975-4d41-bc72-1c1da0136998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:04 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Volume 31b7e348-ac8d-4e20-8887-68f66a021845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b7e348-ac8d-4e20-8887-68f66a021845', 'volume_size': 1} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1686269485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b7e348-ac8d-4e20-8887-68f66a021845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb2aee0202145a58d644018046bc809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:05Z,use_quota=True,user_id='29dc43cf39d740979a537c12ddb74e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Creating volume 31b7e348-ac8d-4e20-8887-68f66a021845 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:04 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:05 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845 1073741824 Jul 23 03:26:05 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:05 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (a4edfa1e-b6d9-416a-b005-dba378471137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f8d4c2-1620-4d85-93a3-b93bb8b908ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f8d4c2-1620-4d85-93a3-b93bb8b908ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1311326762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41c1d95-3b34-402b-8d72-3a037e797ea0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:05Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e1c8ba-440a-418a-aef0-f4078411b79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e1c8ba-440a-418a-aef0-f4078411b79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72261dca-643a-41d6-b7a3-4658330d09d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:05 devstack cinder-volume[88392]: DEBUG cinder.image.glance [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Creating Keystone auth plugin from conf {{(pid=88392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:26:05 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845 1073741824" returned: 0 in 0.644s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:05 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845 Jul 23 03:26:05 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72261dca-643a-41d6-b7a3-4658330d09d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a41c1d95-3b34-402b-8d72-3a037e797ea0', 'volume_name': 'volume-a41c1d95-3b34-402b-8d72-3a037e797ea0', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cc0523-4bf5-4035-96ae-758473b35735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cc0523-4bf5-4035-96ae-758473b35735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ab2b34-1cb6-4bf8-846d-ab0d3046e1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:06 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Volume a41c1d95-3b34-402b-8d72-3a037e797ea0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a41c1d95-3b34-402b-8d72-3a037e797ea0', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Trying to clone a41c1d95-3b34-402b-8d72-3a037e797ea0 from image 2d810839-198a-4642-93d6-ed27296a0802 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]). {{(pid=88392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:26:06 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845" returned: 0 in 0.392s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf77808-4975-4d41-bc72-1c1da0136998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b7e348-ac8d-4e20-8887-68f66a021845', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024b1b78-1c35-44b9-b7d1-6a32de64a52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:06 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Volume volume-31b7e348-ac8d-4e20-8887-68f66a021845 (31b7e348-ac8d-4e20-8887-68f66a021845): created successfully Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024b1b78-1c35-44b9-b7d1-6a32de64a52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Flow 'volume_create_manager' (5bfa35a3-87cb-4745-8f53-337d47b40485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:06 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-cf894f2d-ac66-4ad3-a64f-315463872738 tempest-VolumesTransfersV357Test-924174435 None] Created volume successfully. Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:26:06 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Image download 20.69 MB at 20.69 MB/s Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecc7292-b177-4f75-aaa0-c9760e19e0bd]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:06 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD Jul 23 03:26:06 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:06 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:06 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:07 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD" returned: 0 in 0.458s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Temporary image 2d810839-198a-4642-93d6-ed27296a0802 is fetched for user 1fe3a2b02b5a4317b8fbd16cfb1387f8. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ff8602-ae62-44bd-bb89-c5117a2ce599]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:07 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD Jul 23 03:26:07 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:07 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.523s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:26:07 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD" returned: 0 in 0.419s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1311326762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41c1d95-3b34-402b-8d72-3a037e797ea0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:05Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Creating volume a41c1d95-3b34-402b-8d72-3a037e797ea0 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:07 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:07 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 1073741824 Jul 23 03:26:07 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:08 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f66ea678-c8f3-45b4-9af2-d82422d97dc4 tempest-VolumesTransfersV357Test-307279834 None] Transfer volume completed successfully. Jul 23 03:26:08 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 1073741824" returned: 0 in 0.675s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:08 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 Jul 23 03:26:08 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:08 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0" returned: 0 in 0.411s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:08 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Attempting download of 2d810839-198a-4642-93d6-ed27296a0802 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}])) to volume a41c1d95-3b34-402b-8d72-3a037e797ea0. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:26:08 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2471ac16-d2bf-4427-80af-42b1d27e95ba]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_mx5hnjz0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:09 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_mx5hnjz0 Jul 23 03:26:09 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Acquiring lock "cinder-31b7e348-ac8d-4e20-8887-68f66a021845-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Lock "cinder-31b7e348-ac8d-4e20-8887-68f66a021845-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Acquiring lock "cinder-quobyte-31b7e348-ac8d-4e20-8887-68f66a021845" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Lock "cinder-quobyte-31b7e348-ac8d-4e20-8887-68f66a021845" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bb49bb-1601-41b2-a81e-8d52094d260c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:09 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_mx5hnjz0" returned: 0 in 0.514s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_mx5hnjz0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:09 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845 Jul 23 03:26:09 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:09 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_mx5hnjz0 Jul 23 03:26:09 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:09 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845" returned: 0 in 0.428s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:09 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845 Jul 23 03:26:09 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:09 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_mx5hnjz0" returned: 1 in 0.368s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_mx5hnjz0' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91391f1-76e1-4d49-842e-7946e2a5bf50]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:09 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD Jul 23 03:26:09 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:10 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-31b7e348-ac8d-4e20-8887-68f66a021845" returned: 0 in 0.343s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Lock "cinder-quobyte-31b7e348-ac8d-4e20-8887-68f66a021845" released by "delete_volume" :: held 0.832s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Created reservations ['c6d89510-3a9a-4d0a-b8b3-221adad85090', '2b27ca71-d6e0-4179-a6fe-b3d1d6541a78', '1309404a-45d4-4760-8904-290dabbe3cd9', 'b5390bc4-bd98-4ca1-8700-1180fd975086'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:10 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD" returned: 0 in 0.419s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] 2d810839-198a-4642-93d6-ed27296a0802 was qcow2, converting to qcow2 {{(pid=88392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:10 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:10 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:10 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:10 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:10 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.351s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:10 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Deleted volume successfully. Jul 23 03:26:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09d5409d-48d9-431c-a20c-fcf2ec41bbd7 tempest-VolumesTransfersV357Test-5681392 None] Lock "cinder-31b7e348-ac8d-4e20-8887-68f66a021845-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Flow 'volume_create_manager' (c4dbeef5-ed55-4c76-bbda-0915b8f4c76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5161372a-1c63-47a5-b132-2052ad64df5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5161372a-1c63-47a5-b132-2052ad64df5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1703280527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb2aee0202145a58d644018046bc809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:11Z,use_quota=True,user_id='29dc43cf39d740979a537c12ddb74e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f6ce59-c041-4985-a55b-6eaf728fcc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f6ce59-c041-4985-a55b-6eaf728fcc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38298fcb-547a-47b0-bb40-89f79ad782fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38298fcb-547a-47b0-bb40-89f79ad782fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b', 'volume_name': 'volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17e5f06-e07f-4e3d-937f-9f5584d2234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17e5f06-e07f-4e3d-937f-9f5584d2234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c726c4-c271-4cd1-9f29-31f8097673dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:11 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Volume 7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b', 'volume_size': 1} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1703280527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feb2aee0202145a58d644018046bc809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:11Z,use_quota=True,user_id='29dc43cf39d740979a537c12ddb74e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Creating volume 7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:11 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:11 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b 1073741824 Jul 23 03:26:11 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:11 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b 1073741824" returned: 0 in 0.586s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:11 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b Jul 23 03:26:11 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:12 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b" returned: 0 in 0.363s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c726c4-c271-4cd1-9f29-31f8097673dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36450d4d-8215-4cd0-b2c6-667465baec07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:12 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Volume volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b (7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b): created successfully Jul 23 03:26:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36450d4d-8215-4cd0-b2c6-667465baec07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Flow 'volume_create_manager' (c4dbeef5-ed55-4c76-bbda-0915b8f4c76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:12 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-51a4a4a3-5675-4c3f-af42-a1984039b972 tempest-VolumesTransfersV357Test-924174435 None] Created volume successfully. Jul 23 03:26:12 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0" returned: 0 in 2.420s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:12 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_c8jggr44devstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:26:12 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Converted 112.00 MB image at 46.26 MB/s Jul 23 03:26:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:12 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 1G Jul 23 03:26:12 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:13 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 1G" returned: 0 in 0.542s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Downloaded image 2d810839-198a-4642-93d6-ed27296a0802 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}])) to volume a41c1d95-3b34-402b-8d72-3a037e797ea0 successfully. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Temporary image 2d810839-198a-4642-93d6-ed27296a0802 for user 1fe3a2b02b5a4317b8fbd16cfb1387f8 is deleted. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Marking volume a41c1d95-3b34-402b-8d72-3a037e797ea0 as bootable. {{(pid=88392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Copying metadata from image 2d810839-198a-4642-93d6-ed27296a0802 to a41c1d95-3b34-402b-8d72-3a037e797ea0. {{(pid=88392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Creating volume glance metadata for volume a41c1d95-3b34-402b-8d72-3a037e797ea0 backed by image 2d810839-198a-4642-93d6-ed27296a0802 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ab2b34-1cb6-4bf8-846d-ab0d3046e1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41c1d95-3b34-402b-8d72-3a037e797ea0', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be8e41e-57a8-4f9f-a5ee-4922c8ea62cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:13 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Volume volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 (a41c1d95-3b34-402b-8d72-3a037e797ea0): created successfully Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be8e41e-57a8-4f9f-a5ee-4922c8ea62cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (a4edfa1e-b6d9-416a-b005-dba378471137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-34150bce-ad13-4b3a-bdb0-6acfa1e4e927 tempest-VolumesGetTest-909272433 None] Created volume successfully. Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Acquiring lock "cinder-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Lock "cinder-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Acquiring lock "cinder-quobyte-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Lock "cinder-quobyte-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1889a048-1593-4d2e-b788-0c7c410a8530]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:13 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b Jul 23 03:26:13 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:14 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b" returned: 0 in 0.597s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:14 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b Jul 23 03:26:14 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:14 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b" returned: 0 in 0.471s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Lock "cinder-quobyte-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b" released by "delete_volume" :: held 1.134s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:14 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Created reservations ['d5f25072-8976-4d8f-9a87-f4694c1545e3', '1d28bbc0-b966-47f6-8b81-73adf23e458d', '168f1b9d-f75e-4aaa-ac28-a57e999871fb', '12d9f4d6-2b3b-40b6-b24f-8fffae6afb77'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:15 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:15 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (158884ca-962a-43a5-88c7-aded9f62c1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c4a3b1-1156-44c8-96c0-ed8ab92d885a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c4a3b1-1156-44c8-96c0-ed8ab92d885a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1853889373',display_name='tempest-VolumesGetTest-Volume-343207881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea4c5b3-d750-4c92-8e2a-7e6868518a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:15Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6216c51-0384-469a-a104-7299ca805c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6216c51-0384-469a-a104-7299ca805c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b88840-6d7e-482f-8262-fba76281f5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b88840-6d7e-482f-8262-fba76281f5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea4c5b3-d750-4c92-8e2a-7e6868518a5c', 'volume_name': 'volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80da2626-366b-4d91-be8d-cacb25ab1f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80da2626-366b-4d91-be8d-cacb25ab1f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa506f9-d2c1-42a8-bae7-44496addc389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:15 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Volume 6ea4c5b3-d750-4c92-8e2a-7e6868518a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c', 'volume_size': 1} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1853889373',display_name='tempest-VolumesGetTest-Volume-343207881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea4c5b3-d750-4c92-8e2a-7e6868518a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe0442d0d5e4763a524d7ecb8c3a774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:15Z,use_quota=True,user_id='1fe3a2b02b5a4317b8fbd16cfb1387f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Creating volume 6ea4c5b3-d750-4c92-8e2a-7e6868518a5c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:15 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:15 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c 1073741824 Jul 23 03:26:15 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:15 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.365s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Deleted volume successfully. Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-235ee3c8-68b5-4f5d-9af7-6318a2be7f32 tempest-VolumesTransfersV357Test-5681392 None] Lock "cinder-7bdb1a0c-576e-4abb-8ec2-b5a6b620e92b-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:15 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c 1073741824" returned: 0 in 0.679s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:16 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c Jul 23 03:26:16 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:16 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c" returned: 0 in 0.292s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa506f9-d2c1-42a8-bae7-44496addc389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8670af0-988c-4ac8-b523-39e87d7403a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:16 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Volume volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c (6ea4c5b3-d750-4c92-8e2a-7e6868518a5c): created successfully Jul 23 03:26:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8670af0-988c-4ac8-b523-39e87d7403a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Flow 'volume_create_manager' (158884ca-962a-43a5-88c7-aded9f62c1ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f969594e-8a89-4039-87ab-f666ff71231d tempest-VolumesGetTest-909272433 None] Created volume successfully. Jul 23 03:26:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Lock "cinder-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-quobyte-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:17 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58867ac-f541-4b20-9532-c9d5774b3e56]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:17 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c Jul 23 03:26:17 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:18 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c" returned: 0 in 0.576s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:18 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c Jul 23 03:26:18 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:18 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c" returned: 0 in 0.382s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c" released by "delete_volume" :: held 1.015s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:18 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=166,cinder:INSERT=59,cinder:UPDATE=210,cinder:DELETE=17 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:26:18 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Created reservations ['af00f5cd-9e37-4afe-b6c9-c3aed69737b8', 'a4934559-5f78-40b7-a633-755b936e5570', 'b5d4ff55-2ff5-4e90-b12f-23d5e7abf281', '0083fa18-f192-4e0d-8e95-4bd254846fb4'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:19 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:19 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:19 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.302s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:19 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:19 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Deleted volume successfully. Jul 23 03:26:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-43db545e-c484-4e1a-b0fd-c40d99a0e170 tempest-VolumesGetTest-909272433 None] Lock "cinder-6ea4c5b3-d750-4c92-8e2a-7e6868518a5c-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-a41c1d95-3b34-402b-8d72-3a037e797ea0-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Lock "cinder-a41c1d95-3b34-402b-8d72-3a037e797ea0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Acquiring lock "cinder-quobyte-a41c1d95-3b34-402b-8d72-3a037e797ea0" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-a41c1d95-3b34-402b-8d72-3a037e797ea0" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:20 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3b444a-a09d-406f-9cc2-de3c8c78261b]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:20 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 Jul 23 03:26:20 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:20 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0" returned: 0 in 0.521s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:20 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0 Jul 23 03:26:20 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:21 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a41c1d95-3b34-402b-8d72-3a037e797ea0" returned: 0 in 0.360s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Lock "cinder-quobyte-a41c1d95-3b34-402b-8d72-3a037e797ea0" released by "delete_volume" :: held 0.937s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Created reservations ['9ce570a1-0ed6-4b1d-bbba-d4768acf7a1e', '5a0ac1eb-bc84-47c8-8272-a6a6278a9c41', 'c26de84c-2bdb-4344-ae73-5e8e61edf4f2', '6ed51f4d-df2a-4017-8f68-6fb722ffe54d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:21 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:21 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:21 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.326s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:21 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Deleted volume successfully. Jul 23 03:26:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-db3ac146-2aee-4b7b-a4a8-94fc5e38ca3c tempest-VolumesGetTest-909272433 None] Lock "cinder-a41c1d95-3b34-402b-8d72-3a037e797ea0-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:22 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Flow 'volume_create_manager' (4c047f5e-8d58-4453-8508-91ed1282504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de581a41-fb58-4d3b-988d-bd254e196b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de581a41-fb58-4d3b-988d-bd254e196b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1205922045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cae1010-068b-4c49-ba92-41614dcbcbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ba52489e77478499c1406259fb360b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:23Z,use_quota=True,user_id='b56b436303a547a69748d2dec3dd3e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e5be5c-849a-467f-aab0-f7c1b7b2213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e5be5c-849a-467f-aab0-f7c1b7b2213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5e9ff3-8d43-419f-a404-e0823cee9b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5e9ff3-8d43-419f-a404-e0823cee9b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cae1010-068b-4c49-ba92-41614dcbcbcf', 'volume_name': 'volume-5cae1010-068b-4c49-ba92-41614dcbcbcf', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42a01df-337a-4bda-80e4-49d1cdf81cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42a01df-337a-4bda-80e4-49d1cdf81cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c70d492-546f-403d-a41b-9e24a7100619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:23 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Volume 5cae1010-068b-4c49-ba92-41614dcbcbcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cae1010-068b-4c49-ba92-41614dcbcbcf', 'volume_size': 1} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1205922045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cae1010-068b-4c49-ba92-41614dcbcbcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ba52489e77478499c1406259fb360b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:23Z,use_quota=True,user_id='b56b436303a547a69748d2dec3dd3e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Creating volume 5cae1010-068b-4c49-ba92-41614dcbcbcf {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:23 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:23 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf 1073741824 Jul 23 03:26:23 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:23 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf 1073741824" returned: 0 in 0.645s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:23 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf Jul 23 03:26:23 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:24 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf" returned: 0 in 0.311s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c70d492-546f-403d-a41b-9e24a7100619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cae1010-068b-4c49-ba92-41614dcbcbcf', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babaaaeb-ec60-4cc8-99f6-65ce95a471b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:24 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Volume volume-5cae1010-068b-4c49-ba92-41614dcbcbcf (5cae1010-068b-4c49-ba92-41614dcbcbcf): created successfully Jul 23 03:26:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babaaaeb-ec60-4cc8-99f6-65ce95a471b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Flow 'volume_create_manager' (4c047f5e-8d58-4453-8508-91ed1282504b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:24 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ccee86d6-8969-4736-a126-5303731b77e2 tempest-TestStampPattern-886894386 None] Created volume successfully. Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=195,cinder:DELETE=17,cinder:SELECT=161,cinder:INSERT=58 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Flow 'volume_create_manager' (80e39c67-b237-45d2-a031-d7da6102e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bdd36a-a2a6-4f49-9e30-aadd68d0bb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bdd36a-a2a6-4f49-9e30-aadd68d0bb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-705159635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d143c11ef24634b792b05e99604d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:27Z,use_quota=True,user_id='19280e5152a740cfbf4aec8d0ec6204f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd41dbc-a607-4263-b038-30d220a89136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd41dbc-a607-4263-b038-30d220a89136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7171e7c8-1017-4337-a348-123f0019138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7171e7c8-1017-4337-a348-123f0019138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c', 'volume_name': 'volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b917bd5e-87f9-4eb5-82a8-873f4637d458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b917bd5e-87f9-4eb5-82a8-873f4637d458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3141b11b-c865-402b-9fc5-902014fdc74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:26 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Volume 91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c', 'volume_size': 1} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-705159635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d143c11ef24634b792b05e99604d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:27Z,use_quota=True,user_id='19280e5152a740cfbf4aec8d0ec6204f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Creating volume 91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:26 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:26 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c 1073741824 Jul 23 03:26:26 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:27 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c 1073741824" returned: 0 in 0.649s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:27 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c Jul 23 03:26:27 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:27 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c" returned: 0 in 0.314s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3141b11b-c865-402b-9fc5-902014fdc74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280f4144-f207-4a13-9c7a-d16c35e45c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:27 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Volume volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c (91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c): created successfully Jul 23 03:26:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280f4144-f207-4a13-9c7a-d16c35e45c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Flow 'volume_create_manager' (80e39c67-b237-45d2-a031-d7da6102e233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:27 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-046a0942-efe9-436e-9281-4060ef034db4 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Created volume successfully. Jul 23 03:26:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Acquiring lock "cinder-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "cinder-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Acquiring lock "cinder-quobyte-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "cinder-quobyte-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:29 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70607d6-cef6-4253-9ab8-ab5d1db8a6f8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:29 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c Jul 23 03:26:29 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:29 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c" returned: 0 in 0.455s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:29 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c Jul 23 03:26:29 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:29 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c" returned: 0 in 0.349s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "cinder-quobyte-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c" released by "delete_volume" :: held 0.866s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:29 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Created reservations ['33727e88-3472-46da-8181-8bf48efba198', '4907ddc0-9d7b-4c37-8a20-3085d0444d07', 'aa5cab91-99b7-4f1e-87c9-f6656030151b', 'a3610212-bff3-4e02-9391-60f669c83fe8'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:30 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:30 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:30 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.397s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:30 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Deleted volume successfully. Jul 23 03:26:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-95e8953f-7d29-489b-8313-6e33fb14745b tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "cinder-91c60ab8-3e7b-4e7c-91fe-86a8114ebc6c-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Flow 'volume_create_manager' (1cdbf8ab-d456-4d6e-abba-59b9057899aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c16851-1ddc-45bf-8594-c8536d76fd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c16851-1ddc-45bf-8594-c8536d76fd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2019587802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d37d79-7eaf-4cb6-91e8-b0d953e0776f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d143c11ef24634b792b05e99604d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:31Z,use_quota=True,user_id='19280e5152a740cfbf4aec8d0ec6204f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a956a87b-98b8-4418-bbf3-731504599dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a956a87b-98b8-4418-bbf3-731504599dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c6b664-17c4-41d8-99e2-3bd836457397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c6b664-17c4-41d8-99e2-3bd836457397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d37d79-7eaf-4cb6-91e8-b0d953e0776f', 'volume_name': 'volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b069dd0d-f229-48de-8af3-05860301d17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b069dd0d-f229-48de-8af3-05860301d17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ba0f4e-3cd2-4d13-93df-494831a48819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:31 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Volume a5d37d79-7eaf-4cb6-91e8-b0d953e0776f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f', 'volume_size': 1} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2019587802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d37d79-7eaf-4cb6-91e8-b0d953e0776f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59d143c11ef24634b792b05e99604d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:31Z,use_quota=True,user_id='19280e5152a740cfbf4aec8d0ec6204f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Creating volume a5d37d79-7eaf-4cb6-91e8-b0d953e0776f {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:31 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:31 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f 1073741824 Jul 23 03:26:31 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Flow 'volume_create_manager' (b7cc4d3e-4315-45d5-91a5-6673f40817d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb86e9e-8159-4a13-86c9-f56ee03c1a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb86e9e-8159-4a13-86c9-f56ee03c1a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-636128266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744e2812-3802-4f6b-8e43-ee9037985043,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51d23d14cff941d4aa68222280e88c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:32Z,use_quota=True,user_id='3e7962d78ffa4acbbabcf16b7f9a3533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a012e75-7bf8-4f5a-9ef5-df9f8e46092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a012e75-7bf8-4f5a-9ef5-df9f8e46092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1db6c3-c05a-49ea-b200-adf1e81fd04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1db6c3-c05a-49ea-b200-adf1e81fd04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '744e2812-3802-4f6b-8e43-ee9037985043', 'volume_name': 'volume-744e2812-3802-4f6b-8e43-ee9037985043', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4eb1f53-bebb-444c-94e7-872a4d9c1f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4eb1f53-bebb-444c-94e7-872a4d9c1f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6803afa9-14ce-44b4-88e9-c3ad2fa692da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:32 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Volume 744e2812-3802-4f6b-8e43-ee9037985043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-744e2812-3802-4f6b-8e43-ee9037985043', 'volume_size': 1} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:32 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f 1073741824" returned: 0 in 0.916s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:32 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f Jul 23 03:26:32 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:32 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f" returned: 0 in 0.291s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.362s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-636128266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744e2812-3802-4f6b-8e43-ee9037985043,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51d23d14cff941d4aa68222280e88c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:32Z,use_quota=True,user_id='3e7962d78ffa4acbbabcf16b7f9a3533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Creating volume 744e2812-3802-4f6b-8e43-ee9037985043 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:32 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ba0f4e-3cd2-4d13-93df-494831a48819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:32 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043 1073741824 Jul 23 03:26:32 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39cf239e-03bf-405d-b0cd-ea885c35c6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:32 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Volume volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f (a5d37d79-7eaf-4cb6-91e8-b0d953e0776f): created successfully Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39cf239e-03bf-405d-b0cd-ea885c35c6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Flow 'volume_create_manager' (1cdbf8ab-d456-4d6e-abba-59b9057899aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:32 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e53a4e2c-23b8-49d2-bc72-f96903c304f6 tempest-VolumeQuotasAdminTestJSON-2116786924 None] Created volume successfully. Jul 23 03:26:33 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043 1073741824" returned: 0 in 0.936s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:33 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043 Jul 23 03:26:33 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:34 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043" returned: 0 in 0.652s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6803afa9-14ce-44b4-88e9-c3ad2fa692da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744e2812-3802-4f6b-8e43-ee9037985043', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6af387-c040-44e4-93c0-dc75d8cd62df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:34 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Volume volume-744e2812-3802-4f6b-8e43-ee9037985043 (744e2812-3802-4f6b-8e43-ee9037985043): created successfully Jul 23 03:26:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6af387-c040-44e4-93c0-dc75d8cd62df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Flow 'volume_create_manager' (b7cc4d3e-4315-45d5-91a5-6673f40817d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:34 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-454daee7-cd1c-4522-b557-71b3b6e7575f tempest-VolumesListTestJSON-311213389 None] Created volume successfully. Jul 23 03:26:35 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1a7d2238-37e0-47a1-b107-7034a9d82818 tempest-VolumeQuotasAdminTestJSON-1572577042 None] Transfer volume completed successfully. Jul 23 03:26:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Acquiring lock "cinder-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Lock "cinder-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Acquiring lock "cinder-quobyte-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Lock "cinder-quobyte-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f" acquired by "delete_volume" :: waited 0.033s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:36 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d9c2e9-e6a2-4c84-b111-c57b7e7a29c7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:36 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Flow 'volume_create_manager' (bc8b5ca5-a626-44e5-9ca2-9c2672c4df1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebdcb35-2168-4e0e-a1dc-6bf704650aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:37 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f Jul 23 03:26:37 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebdcb35-2168-4e0e-a1dc-6bf704650aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-122702533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfacebd8-eebc-46fc-a511-e35acefd8db2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51d23d14cff941d4aa68222280e88c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:37Z,use_quota=True,user_id='3e7962d78ffa4acbbabcf16b7f9a3533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9379cb-7ab5-4d62-9c35-d8159f58c450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9379cb-7ab5-4d62-9c35-d8159f58c450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1d0884-2b44-4e48-8f7a-1e6a82ae5616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1d0884-2b44-4e48-8f7a-1e6a82ae5616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfacebd8-eebc-46fc-a511-e35acefd8db2', 'volume_name': 'volume-dfacebd8-eebc-46fc-a511-e35acefd8db2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79178a61-a357-4ca4-a520-1cc9069b7256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79178a61-a357-4ca4-a520-1cc9069b7256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf3480d-96d8-429b-85b1-878ab5e9c1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:37 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Volume dfacebd8-eebc-46fc-a511-e35acefd8db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfacebd8-eebc-46fc-a511-e35acefd8db2', 'volume_size': 1} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-122702533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfacebd8-eebc-46fc-a511-e35acefd8db2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51d23d14cff941d4aa68222280e88c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:37Z,use_quota=True,user_id='3e7962d78ffa4acbbabcf16b7f9a3533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Creating volume dfacebd8-eebc-46fc-a511-e35acefd8db2 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:37 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:37 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2 1073741824 Jul 23 03:26:37 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:37 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f" returned: 0 in 0.652s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:37 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f Jul 23 03:26:37 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:37 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f" returned: 0 in 0.485s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Lock "cinder-quobyte-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f" released by "delete_volume" :: held 1.222s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Created reservations ['87f2bd98-8db9-4fb5-b5f9-381b546e5c01', 'bdee69e0-7ae4-487b-81ad-c2877be6ff93', '0e41c1ec-215e-44eb-a9e4-8e8fd7e5c1a5', 'dde99681-878a-42ae-886e-db7fecc9f7a1'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:38 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2 1073741824" returned: 0 in 0.964s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:38 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2 Jul 23 03:26:38 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:38 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:38 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:38 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2" returned: 0 in 0.493s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf3480d-96d8-429b-85b1-878ab5e9c1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfacebd8-eebc-46fc-a511-e35acefd8db2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200f8296-efb7-459d-b6ec-551538ea8b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:38 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Volume volume-dfacebd8-eebc-46fc-a511-e35acefd8db2 (dfacebd8-eebc-46fc-a511-e35acefd8db2): created successfully Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200f8296-efb7-459d-b6ec-551538ea8b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Flow 'volume_create_manager' (bc8b5ca5-a626-44e5-9ca2-9c2672c4df1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:38 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ba2e1576-31ba-4c71-b4f2-42208fa7206a tempest-VolumesListTestJSON-311213389 None] Created volume successfully. Jul 23 03:26:39 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.729s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:39 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Deleted volume successfully. Jul 23 03:26:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-36f78b6c-6069-40fd-acf3-6d0193019dc8 tempest-VolumeQuotasAdminTestJSON-1421046796 None] Lock "cinder-a5d37d79-7eaf-4cb6-91e8-b0d953e0776f-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Flow 'volume_create_manager' (4773cbe1-5c4c-40a4-a8ed-468b1b1f1abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df40da2-dee5-4bff-8c4e-06aba1298272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df40da2-dee5-4bff-8c4e-06aba1298272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1616275951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170821f0-bca3-41bc-995e-973dfe858b62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51d23d14cff941d4aa68222280e88c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:40Z,use_quota=True,user_id='3e7962d78ffa4acbbabcf16b7f9a3533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a612f549-6a43-4358-bfc2-1e4b1c8b4abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a612f549-6a43-4358-bfc2-1e4b1c8b4abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3857839-fb9b-4e8d-814d-cf3ed2357b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3857839-fb9b-4e8d-814d-cf3ed2357b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '170821f0-bca3-41bc-995e-973dfe858b62', 'volume_name': 'volume-170821f0-bca3-41bc-995e-973dfe858b62', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56118829-9269-4b69-afce-f5614a4ed50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56118829-9269-4b69-afce-f5614a4ed50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f3472d-24bb-4a71-a567-1a18d0a11b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Volume 170821f0-bca3-41bc-995e-973dfe858b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-170821f0-bca3-41bc-995e-973dfe858b62', 'volume_size': 1} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1616275951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170821f0-bca3-41bc-995e-973dfe858b62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51d23d14cff941d4aa68222280e88c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:40Z,use_quota=True,user_id='3e7962d78ffa4acbbabcf16b7f9a3533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Creating volume 170821f0-bca3-41bc-995e-973dfe858b62 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:40 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:40 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62 1073741824 Jul 23 03:26:40 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:41 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62 1073741824" returned: 0 in 1.047s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:41 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62 Jul 23 03:26:41 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:42 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62" returned: 0 in 0.485s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f3472d-24bb-4a71-a567-1a18d0a11b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-170821f0-bca3-41bc-995e-973dfe858b62', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5272b42d-0aea-4e38-909e-bbe770cb967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:42 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Volume volume-170821f0-bca3-41bc-995e-973dfe858b62 (170821f0-bca3-41bc-995e-973dfe858b62): created successfully Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5272b42d-0aea-4e38-909e-bbe770cb967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Flow 'volume_create_manager' (4773cbe1-5c4c-40a4-a8ed-468b1b1f1abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3dbe1193-4048-4aba-94dc-f5050685fbef tempest-VolumesListTestJSON-311213389 None] Created volume successfully. Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Flow 'volume_create_manager' (9331ffc3-ae5c-40ec-ac77-91dd959a1bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02085e7e-9ca2-451b-ab0b-e82192e81b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02085e7e-9ca2-451b-ab0b-e82192e81b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2059225610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b85e302-fa3f-48d8-b4b6-adc1e178bb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58bb57f8aee4e87814f9995ef99c0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:43Z,use_quota=True,user_id='717d929a025a40fb8f8d4befa09ae065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b21adf-3e14-455b-86d5-5732f70b1a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b21adf-3e14-455b-86d5-5732f70b1a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59274a4-6270-41e3-8d77-4b5c4417a69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59274a4-6270-41e3-8d77-4b5c4417a69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b85e302-fa3f-48d8-b4b6-adc1e178bb4f', 'volume_name': 'volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51c1e25-fff3-46a4-ab95-6314fe18ddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51c1e25-fff3-46a4-ab95-6314fe18ddfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d46e0e6-5a4f-463e-9bed-515bdea2fa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:42 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Volume 0b85e302-fa3f-48d8-b4b6-adc1e178bb4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f', 'volume_size': 1} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2059225610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b85e302-fa3f-48d8-b4b6-adc1e178bb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58bb57f8aee4e87814f9995ef99c0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:43Z,use_quota=True,user_id='717d929a025a40fb8f8d4befa09ae065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Creating volume 0b85e302-fa3f-48d8-b4b6-adc1e178bb4f {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:42 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:43 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f 1073741824 Jul 23 03:26:43 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:43 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f 1073741824" returned: 0 in 0.636s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:43 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f Jul 23 03:26:43 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:44 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f" returned: 0 in 0.474s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d46e0e6-5a4f-463e-9bed-515bdea2fa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4e4a13-0869-4304-bb9b-dbbb623a226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:44 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Volume volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f (0b85e302-fa3f-48d8-b4b6-adc1e178bb4f): created successfully Jul 23 03:26:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4e4a13-0869-4304-bb9b-dbbb623a226d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Flow 'volume_create_manager' (9331ffc3-ae5c-40ec-ac77-91dd959a1bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1cceb86d-7f3c-4788-90ff-2688be557b74 tempest-VolumesSnapshotTestJSON-769971426 None] Created volume successfully. Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Acquiring lock "cinder-170821f0-bca3-41bc-995e-973dfe858b62-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-170821f0-bca3-41bc-995e-973dfe858b62-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Acquiring lock "cinder-quobyte-170821f0-bca3-41bc-995e-973dfe858b62" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-quobyte-170821f0-bca3-41bc-995e-973dfe858b62" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b23800-31d9-4f9b-9f49-352a71246bc3]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:45 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62 Jul 23 03:26:45 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] Creating offline snapshot 2db1311c-ae2a-4d2a-90b9-91a373b9b096 of volume 0b85e302-fa3f-48d8-b4b6-adc1e178bb4f {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[87afe3aa-ff5e-42c8-9c31-71fbbbf2c79d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:45 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62" returned: 0 in 0.552s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:45 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f Jul 23 03:26:45 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:45 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62 Jul 23 03:26:45 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:46 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-170821f0-bca3-41bc-995e-973dfe858b62" returned: 0 in 0.338s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-quobyte-170821f0-bca3-41bc-995e-973dfe858b62" released by "delete_volume" :: held 0.989s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:46 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f" returned: 0 in 0.526s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:46 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 1G Jul 23 03:26:46 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Created reservations ['0ab2f3cd-0f09-4f8a-979a-a794f0e9862a', '502bcd9e-ad29-4b46-bdb3-1a513bfc3dc3', '2e6582d3-df95-4ada-a989-9594ea35baf9', 'ba18d086-c93b-4673-83dd-6b11ca66935f'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:46 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:46 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:46 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.293s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Deleted volume successfully. Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ef4c972-f535-4534-83c5-48db1dceee17 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-170821f0-bca3-41bc-995e-973dfe858b62-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:46 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 1G" returned: 0 in 0.548s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:46 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 Jul 23 03:26:46 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:47 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096" returned: 0 in 0.327s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:47 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 is being set with open permissions: ugo+rw Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:47 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 Jul 23 03:26:47 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:47 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096" returned: 0 in 0.249s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:47 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.info Jul 23 03:26:47 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Acquiring lock "cinder-dfacebd8-eebc-46fc-a511-e35acefd8db2-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-dfacebd8-eebc-46fc-a511-e35acefd8db2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Acquiring lock "cinder-quobyte-dfacebd8-eebc-46fc-a511-e35acefd8db2" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-quobyte-dfacebd8-eebc-46fc-a511-e35acefd8db2" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a04df0-185d-47ac-a5ee-593ad272b1c2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:47 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.info" returned: 0 in 0.281s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:47 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.info is being set with open permissions: ugo+rw Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:47 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.info Jul 23 03:26:47 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:47 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2 Jul 23 03:26:47 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:47 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.info" returned: 0 in 0.275s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:48 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c83865e4-87a6-4b3c-b6b1-29456589a044 tempest-VolumesSnapshotTestJSON-769971426 None] Create snapshot completed successfully Jul 23 03:26:48 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2" returned: 0 in 0.427s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:48 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2 Jul 23 03:26:48 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:48 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dfacebd8-eebc-46fc-a511-e35acefd8db2" returned: 0 in 0.251s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-quobyte-dfacebd8-eebc-46fc-a511-e35acefd8db2" released by "delete_volume" :: held 0.736s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Created reservations ['4bfe5fe9-28a9-40f5-a7f9-678f5bde3d8c', 'a8b4994f-e106-4ec3-822b-8240f110368f', '7388524a-414d-4812-a25f-15d544f30847', '382c6910-1e6f-4859-bf1a-31a738107f41'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:48 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:48 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:48 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.255s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:48 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Deleted volume successfully. Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bb2a9881-f504-40b0-8eb9-a2cbbcbceb51 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-dfacebd8-eebc-46fc-a511-e35acefd8db2-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Acquiring lock "cinder-744e2812-3802-4f6b-8e43-ee9037985043-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-744e2812-3802-4f6b-8e43-ee9037985043-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Acquiring lock "cinder-quobyte-744e2812-3802-4f6b-8e43-ee9037985043" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-quobyte-744e2812-3802-4f6b-8e43-ee9037985043" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fca5ac6-3910-4ec0-a4a8-873c81bed460]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:49 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043 Jul 23 03:26:49 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-2db1311c-ae2a-4d2a-90b9-91a373b9b096-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-2db1311c-ae2a-4d2a-90b9-91a373b9b096-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-2db1311c-ae2a-4d2a-90b9-91a373b9b096" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-2db1311c-ae2a-4d2a-90b9-91a373b9b096" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Deleting offline snapshot 2db1311c-ae2a-4d2a-90b9-91a373b9b096 of volume 0b85e302-fa3f-48d8-b4b6-adc1e178bb4f {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] snapshot_file for this snap is: volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d696fb-61c8-4eac-bec3-2fad6cae6ece]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Flow 'volume_create_manager' (9f435c19-0a37-495a-a77f-4e7aefade8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a996a0-cc57-44fd-9580-f8c7c17ea462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a996a0-cc57-44fd-9580-f8c7c17ea462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2048612502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2389a757001142baa29f19da9fcf7604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:49Z,use_quota=True,user_id='8095b46bcbad402fbfc168fad0244296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49162f3e-4ab9-4609-a882-2fd0d4d15933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49162f3e-4ab9-4609-a882-2fd0d4d15933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:49 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e8cc6b-1aff-4be8-90e6-92543a81d95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e8cc6b-1aff-4be8-90e6-92543a81d95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d', 'volume_name': 'volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e91204c-1df2-4be5-a795-b1bd86e4fe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e91204c-1df2-4be5-a795-b1bd86e4fe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d273da2-0e59-4d68-bfd9-5a1867227ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:49 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Volume ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d', 'volume_size': 1} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2048612502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2389a757001142baa29f19da9fcf7604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:49Z,use_quota=True,user_id='8095b46bcbad402fbfc168fad0244296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Creating volume ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:49 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:49 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 Jul 23 03:26:49 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043" returned: 0 in 0.479s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:49 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d 1073741824 Jul 23 03:26:49 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:49 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043 Jul 23 03:26:49 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:49 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744e2812-3802-4f6b-8e43-ee9037985043" returned: 0 in 0.255s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:49 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096" returned: 0 in 0.390s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-quobyte-744e2812-3802-4f6b-8e43-ee9037985043" released by "delete_volume" :: held 0.799s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c000f7a-2124-434d-a314-64257a28423a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Created reservations ['c6392b96-8534-473f-9de9-b247ee3d859f', '1d534d14-67af-44d0-b035-67461f59a895', 'c5c6eb9c-667a-4de0-9419-9fd42dc5568d', 'a99768ef-3253-46a3-b128-810e12f4b3c5'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:49 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f Jul 23 03:26:49 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:49 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:49 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:49 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d 1073741824" returned: 0 in 0.488s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:49 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d Jul 23 03:26:49 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:50 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.290s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:50 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Deleted volume successfully. Jul 23 03:26:50 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f" returned: 0 in 0.453s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45ad02b2-619c-470c-8a20-087049d3c2a2 tempest-VolumesListTestJSON-311213389 None] Lock "cinder-744e2812-3802-4f6b-8e43-ee9037985043-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:50 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 Jul 23 03:26:50 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:50 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d" returned: 0 in 0.375s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d273da2-0e59-4d68-bfd9-5a1867227ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429a17fb-51bf-43ef-9b7f-a12d7a69deea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:50 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Volume volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d (ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d): created successfully Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429a17fb-51bf-43ef-9b7f-a12d7a69deea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Flow 'volume_create_manager' (9f435c19-0a37-495a-a77f-4e7aefade8a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:50 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-dbf8adc4-8ecc-4c4f-974e-8ba550cc8ab0 tempest-VolumesServicesTestJSON-1423594955 None] Created volume successfully. Jul 23 03:26:50 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096" returned: 0 in 0.420s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:50 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096 Jul 23 03:26:50 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:50 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f.2db1311c-ae2a-4d2a-90b9-91a373b9b096" returned: 0 in 0.251s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-2db1311c-ae2a-4d2a-90b9-91a373b9b096" released by "_delete_snapshot" :: held 1.628s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f" released by "delete_snapshot" :: held 1.665s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:50 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Created reservations ['e1138b55-5651-4d29-a723-729abbf5ba04', '0be27fb0-3133-4b55-bb9d-ff0c94844161', '96a6fea6-8dee-4223-871b-743f33398881', '88d68c88-a6da-4edf-8930-21cba44c0060'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:51 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Delete snapshot completed successfully. Jul 23 03:26:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99f79f8f-a6b9-4b9f-a432-6007a6270436 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-2db1311c-ae2a-4d2a-90b9-91a373b9b096-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Acquiring lock "cinder-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Lock "cinder-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Acquiring lock "cinder-quobyte-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Lock "cinder-quobyte-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:51 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[56492d56-4e07-4607-bdd6-7fa8c21f185c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:51 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d Jul 23 03:26:51 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Flow 'volume_create_manager' (2c6958fd-f983-496b-900e-242a883c119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b3521a-4e3e-491e-9c3e-506e8b51eec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b3521a-4e3e-491e-9c3e-506e8b51eec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-961747199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311b7cab-1200-484a-88f4-afa276ad48a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58bb57f8aee4e87814f9995ef99c0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:52Z,use_quota=True,user_id='717d929a025a40fb8f8d4befa09ae065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45e98a2-7641-4087-bb19-90d34765fc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c45e98a2-7641-4087-bb19-90d34765fc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b74510d-1359-4eb9-b9c1-83d7540f3787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b74510d-1359-4eb9-b9c1-83d7540f3787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311b7cab-1200-484a-88f4-afa276ad48a3', 'volume_name': 'volume-311b7cab-1200-484a-88f4-afa276ad48a3', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc975926-bc21-46cb-b5ec-8b1cc0670268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc975926-bc21-46cb-b5ec-8b1cc0670268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b6484c-8772-49ff-afa7-02e1064c2970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:52 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Volume 311b7cab-1200-484a-88f4-afa276ad48a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311b7cab-1200-484a-88f4-afa276ad48a3', 'volume_size': 1} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-961747199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311b7cab-1200-484a-88f4-afa276ad48a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58bb57f8aee4e87814f9995ef99c0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:52Z,use_quota=True,user_id='717d929a025a40fb8f8d4befa09ae065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Creating volume 311b7cab-1200-484a-88f4-afa276ad48a3 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:52 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:52 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d" returned: 0 in 0.475s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:52 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 1073741824 Jul 23 03:26:52 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:52 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d Jul 23 03:26:52 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:52 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d" returned: 0 in 0.351s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Lock "cinder-quobyte-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d" released by "delete_volume" :: held 0.890s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Created reservations ['849fd486-34a4-4b46-ac0f-7c48a18e37b2', '4a1f8422-8fbd-450a-8890-2c902af7f790', '0f1aace2-a062-4bc9-9bf8-45099e3af7db', 'aa8ed2f0-27cd-4c78-9ce9-1db330e87568'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:52 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:26:52 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:52 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 1073741824" returned: 0 in 0.669s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:52 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 Jul 23 03:26:52 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:53 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.370s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:26:53 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Deleted volume successfully. Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3fa0ac59-fce3-4a86-b830-016e3538c663 tempest-VolumesServicesTestJSON-1423594955 None] Lock "cinder-ee59bfe2-ac7d-4fc6-b0fd-c56c31d5f00d-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:26:53 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3" returned: 0 in 0.370s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b6484c-8772-49ff-afa7-02e1064c2970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311b7cab-1200-484a-88f4-afa276ad48a3', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab6341e-e8b2-4a74-b8f0-c995ee6a8e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:53 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Volume volume-311b7cab-1200-484a-88f4-afa276ad48a3 (311b7cab-1200-484a-88f4-afa276ad48a3): created successfully Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab6341e-e8b2-4a74-b8f0-c995ee6a8e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Flow 'volume_create_manager' (2c6958fd-f983-496b-900e-242a883c119e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:53 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-45479360-ce46-47b7-bfb0-c704f73bd835 tempest-VolumesSnapshotTestJSON-769971426 None] Created volume successfully. Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Flow 'volume_create_manager' (f49162fa-41ba-4994-82a3-af429fa99fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542a66ba-6da4-439f-96a1-c72aab2c2442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542a66ba-6da4-439f-96a1-c72aab2c2442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1037796784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a897dc42-729b-4dfa-af30-ad287865f142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c095196a64c84c25a789b17c10578406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:54Z,use_quota=True,user_id='5f7ad4d837bc40888468f9aa08ba5ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97e066b-2690-449f-a1bd-188074f24274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97e066b-2690-449f-a1bd-188074f24274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ff7ab2-6715-4303-b02c-8e9bb0a46d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ff7ab2-6715-4303-b02c-8e9bb0a46d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a897dc42-729b-4dfa-af30-ad287865f142', 'volume_name': 'volume-a897dc42-729b-4dfa-af30-ad287865f142', 'volume_size': 2}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86536138-4cb9-45aa-899a-6fafa431260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86536138-4cb9-45aa-899a-6fafa431260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463bc45e-182e-4350-af6e-7c6223c6c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:53 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Volume a897dc42-729b-4dfa-af30-ad287865f142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a897dc42-729b-4dfa-af30-ad287865f142', 'volume_size': 2} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1037796784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a897dc42-729b-4dfa-af30-ad287865f142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c095196a64c84c25a789b17c10578406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:54Z,use_quota=True,user_id='5f7ad4d837bc40888468f9aa08ba5ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Creating volume a897dc42-729b-4dfa-af30-ad287865f142 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:53 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:26:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 2147483648 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:53 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 2147483648 Jul 23 03:26:53 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:54 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 2147483648" returned: 0 in 0.692s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:54 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 Jul 23 03:26:54 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:54 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142" returned: 0 in 0.271s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.461s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] Creating offline snapshot a56f51b1-819c-4f33-80fd-99413f0b6e9e of volume 311b7cab-1200-484a-88f4-afa276ad48a3 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463bc45e-182e-4350-af6e-7c6223c6c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a897dc42-729b-4dfa-af30-ad287865f142', 'volume_size': 2}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d929d3f1-5264-4c02-9baf-79ac3277d1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c679ae0-0c55-483d-9e50-29f6849159b3]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:54 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Volume volume-a897dc42-729b-4dfa-af30-ad287865f142 (a897dc42-729b-4dfa-af30-ad287865f142): created successfully Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d929d3f1-5264-4c02-9baf-79ac3277d1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:54 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Flow 'volume_create_manager' (f49162fa-41ba-4994-82a3-af429fa99fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:54 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-36c595b1-c0e9-4cb4-9957-e403ef605d3f tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Created volume successfully. Jul 23 03:26:54 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 Jul 23 03:26:54 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:55 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3" returned: 0 in 0.419s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:55 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e 1G Jul 23 03:26:55 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:55 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e 1G" returned: 0 in 0.513s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-311b7cab-1200-484a-88f4-afa276ad48a3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:55 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-311b7cab-1200-484a-88f4-afa276ad48a3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e Jul 23 03:26:55 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:56 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-311b7cab-1200-484a-88f4-afa276ad48a3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e" returned: 0 in 0.410s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:56 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e is being set with open permissions: ugo+rw Jul 23 03:26:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:56 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e Jul 23 03:26:56 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:56 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e" returned: 0 in 0.260s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:56 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.info Jul 23 03:26:56 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:56 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.info" returned: 0 in 0.307s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:56 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.info is being set with open permissions: ugo+rw Jul 23 03:26:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:56 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.info Jul 23 03:26:56 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:57 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.info" returned: 0 in 0.281s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Creating offline snapshot 2d598264-4fd8-48f6-ba6d-a16d69a7e00d of volume a897dc42-729b-4dfa-af30-ad287865f142 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:26:57 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0cffdc1e-55b9-418f-a37e-8043c89741c8 tempest-VolumesSnapshotTestJSON-769971426 None] Create snapshot completed successfully Jul 23 03:26:57 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf378f3-6707-4326-9d06-81c008d307de]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-2d9ab141-6763-44f4-8cfd-06ba20627389 req-5cb2d0ff-7750-4483-b266-c419106f4183 tempest-TestStampPattern-886894386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:57 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 Jul 23 03:26:57 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:57 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142" returned: 0 in 0.403s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d 2G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:57 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d 2G Jul 23 03:26:57 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:58 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d 2G" returned: 0 in 0.523s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a897dc42-729b-4dfa-af30-ad287865f142 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:58 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a897dc42-729b-4dfa-af30-ad287865f142 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d Jul 23 03:26:58 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Flow 'volume_create_manager' (9c5637e1-dd25-4ae4-817d-1d1243ad6746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa75ae8f-7a7a-467b-84dc-96303466787a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa75ae8f-7a7a-467b-84dc-96303466787a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-853171655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d03644d-637e-4226-99c7-c8a11d3cddc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58bb57f8aee4e87814f9995ef99c0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:26:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a56f51b1-819c-4f33-80fd-99413f0b6e9e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:26:58Z,use_quota=True,user_id='717d929a025a40fb8f8d4befa09ae065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176b6750-0f7b-4d72-b4f5-32744b3c6219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176b6750-0f7b-4d72-b4f5-32744b3c6219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe383aa0-ad81-4f53-bac0-c66d1f721949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe383aa0-ad81-4f53-bac0-c66d1f721949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d03644d-637e-4226-99c7-c8a11d3cddc1', 'volume_name': 'volume-8d03644d-637e-4226-99c7-c8a11d3cddc1', 'volume_size': 2, 'snapshot_id': 'a56f51b1-819c-4f33-80fd-99413f0b6e9e'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ff8661-a044-46e7-898d-ccac1b570146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ff8661-a044-46e7-898d-ccac1b570146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b78439-8149-4b40-8c7e-79ca9959f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:58 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Volume 8d03644d-637e-4226-99c7-c8a11d3cddc1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d03644d-637e-4226-99c7-c8a11d3cddc1', 'volume_size': 2, 'snapshot_id': 'a56f51b1-819c-4f33-80fd-99413f0b6e9e'} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:58 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a897dc42-729b-4dfa-af30-ad287865f142 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d" returned: 0 in 0.307s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:58 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d is being set with open permissions: ugo+rw Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:58 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d Jul 23 03:26:58 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:58 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d" returned: 0 in 0.254s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:58 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.info Jul 23 03:26:58 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:58 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.info" returned: 0 in 0.252s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:58 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.info is being set with open permissions: ugo+rw Jul 23 03:26:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:58 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.info Jul 23 03:26:58 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:59 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.info" returned: 0 in 0.260s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-2d9ab141-6763-44f4-8cfd-06ba20627389 req-5cb2d0ff-7750-4483-b266-c419106f4183 tempest-TestStampPattern-886894386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.973s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-2d9ab141-6763-44f4-8cfd-06ba20627389 req-5cb2d0ff-7750-4483-b266-c419106f4183 tempest-TestStampPattern-886894386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.026s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-a56f51b1-819c-4f33-80fd-99413f0b6e9e-8d03644d-637e-4226-99c7-c8a11d3cddc1" by "_create_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:59 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d8ddaf8f-4bfe-46c0-b8cf-68d7aa8fcca8 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Create snapshot completed successfully Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-a56f51b1-819c-4f33-80fd-99413f0b6e9e-8d03644d-637e-4226-99c7-c8a11d3cddc1" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Creating volume 8d03644d-637e-4226-99c7-c8a11d3cddc1 from snapshot a56f51b1-819c-4f33-80fd-99413f0b6e9e {{(pid=88392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-8d03644d-637e-4226-99c7-c8a11d3cddc1" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-8d03644d-637e-4226-99c7-c8a11d3cddc1" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] snapshot: a56f51b1-819c-4f33-80fd-99413f0b6e9e, volume: 8d03644d-637e-4226-99c7-c8a11d3cddc1, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-2d9ab141-6763-44f4-8cfd-06ba20627389 req-5cb2d0ff-7750-4483-b266-c419106f4183 tempest-TestStampPattern-886894386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-5cae1010-068b-4c49-ba92-41614dcbcbcf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '194335e2-21af-4c90-9d97-0bfb1b137b75', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b754fac7-8202-4865-b357-6f4372057e14]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:59 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-2d9ab141-6763-44f4-8cfd-06ba20627389 req-5cb2d0ff-7750-4483-b266-c419106f4183 tempest-TestStampPattern-886894386 None] attachment_update completed successfully. Jul 23 03:26:59 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e Jul 23 03:26:59 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Acquiring lock "cinder-2d598264-4fd8-48f6-ba6d-a16d69a7e00d-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "cinder-2d598264-4fd8-48f6-ba6d-a16d69a7e00d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Acquiring lock "cinder-quobyte-a897dc42-729b-4dfa-af30-ad287865f142" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "cinder-quobyte-a897dc42-729b-4dfa-af30-ad287865f142" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Acquiring lock "cinder-quobyte-2d598264-4fd8-48f6-ba6d-a16d69a7e00d" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "cinder-quobyte-2d598264-4fd8-48f6-ba6d-a16d69a7e00d" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Deleting offline snapshot 2d598264-4fd8-48f6-ba6d-a16d69a7e00d of volume a897dc42-729b-4dfa-af30-ad287865f142 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] snapshot_file for this snap is: volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[db981232-fc48-445a-84f9-cc8acf2fa6cb]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Flow 'volume_create_manager' (1b3a62f0-2234-4a02-a6eb-56f5ca8e5721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:26:59 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80071bba-55f6-4af4-8504-1adb4c9362cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e" returned: 0 in 0.518s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-311b7cab-1200-484a-88f4-afa276ad48a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80071bba-55f6-4af4-8504-1adb4c9362cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-950295761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ec9fb0-d90d-4b0d-928a-50252885d49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba075c0815f4341815f1dc31456eb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:00Z,use_quota=True,user_id='8e6f35e2d51f4b03b390c535f9d9b942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bf173c7-f565-425e-99f3-53abd5ee46ac),volume_type_id=8bf173c7-f565-425e-99f3-53abd5ee46ac)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60f1913-1a26-4666-9c5f-32ed13d748fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60f1913-1a26-4666-9c5f-32ed13d748fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637d0d6c-1442-43b7-b7da-2bcfc0810176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637d0d6c-1442-43b7-b7da-2bcfc0810176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ec9fb0-d90d-4b0d-928a-50252885d49b', 'volume_name': 'volume-18ec9fb0-d90d-4b0d-928a-50252885d49b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7bcb06-2618-4ac4-9dea-253dcc9564aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7bcb06-2618-4ac4-9dea-253dcc9564aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9056db6c-f93b-4df0-ba62-a63695cdd21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:26:59 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Volume 18ec9fb0-d90d-4b0d-928a-50252885d49b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ec9fb0-d90d-4b0d-928a-50252885d49b', 'volume_size': 1} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9285825-88b3-4470-9529-5188a4b88574]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:26:59 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d Jul 23 03:26:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:26:59 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:00 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 Jul 23 03:27:00 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:00 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d" returned: 0 in 0.479s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:00 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a897dc42-729b-4dfa-af30-ad287865f142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:00 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e040d735-d494-4b19-9975-2cd7f8139ddc]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:00 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3" returned: 0 in 0.484s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:00 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:27:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:00 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 Jul 23 03:27:00 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:00 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 Jul 23 03:27:00 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:00 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142" returned: 0 in 0.405s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:00 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d Jul 23 03:27:00 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:01 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d" returned: 0 in 0.626s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:01 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d Jul 23 03:27:01 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:01 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142.2d598264-4fd8-48f6-ba6d-a16d69a7e00d" returned: 0 in 0.528s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "cinder-quobyte-2d598264-4fd8-48f6-ba6d-a16d69a7e00d" released by "_delete_snapshot" :: held 2.221s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "cinder-quobyte-a897dc42-729b-4dfa-af30-ad287865f142" released by "delete_snapshot" :: held 2.290s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:02 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Created reservations ['db36fffc-3943-434f-840c-3c80cbc8083e', '7cd96476-3930-42aa-9928-0c9fb324431e', '310c4202-8e46-44da-a86d-61a0f5907d58', 'a5575bdb-84dc-4bbd-b0e1-8d35efc43862'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:02 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Delete snapshot completed successfully. Jul 23 03:27:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6eefdbf6-f273-4932-8c09-292a48162e15 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "cinder-2d598264-4fd8-48f6-ba6d-a16d69a7e00d-delete_snapshot" released by "delete_snapshot" :: held 2.643s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Acquiring lock "cinder-a897dc42-729b-4dfa-af30-ad287865f142-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "cinder-a897dc42-729b-4dfa-af30-ad287865f142-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Acquiring lock "cinder-quobyte-a897dc42-729b-4dfa-af30-ad287865f142" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "cinder-quobyte-a897dc42-729b-4dfa-af30-ad287865f142" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:03 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0d3cf4-27cb-42d7-85e9-bb69d553d12e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:03 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 Jul 23 03:27:03 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:04 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142" returned: 0 in 0.966s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:04 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142 Jul 23 03:27:04 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:05 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a897dc42-729b-4dfa-af30-ad287865f142" returned: 0 in 0.489s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "cinder-quobyte-a897dc42-729b-4dfa-af30-ad287865f142" released by "delete_volume" :: held 1.628s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Created reservations ['da79e7ca-6625-4d84-b8e8-3dc4d5b18e7c', '7201ac02-7ad1-49dc-9b72-7bab2e9cc7f6', '9389e63e-50f7-4540-be70-874f6754cad4', '3d21b4db-fbeb-4060-81d0-dd30748f1daf'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:05 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:27:05 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:05 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1" returned: 0 in 5.080s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85049cc-208c-4c13-ae0c-9b0747b04f14]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:05 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 Jul 23 03:27:05 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:05 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.341s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:05 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Deleted volume successfully. Jul 23 03:27:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-96e68653-d631-45ef-800f-a4de14dac948 tempest-VolumesSnapshotNegativeTestJSON-2003142816 None] Lock "cinder-a897dc42-729b-4dfa-af30-ad287865f142-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:06 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3" returned: 0 in 0.612s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:27:06 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Converted 1024.00 MB image at 201.51 MB/s Jul 23 03:27:06 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 is being set with open permissions: ugo+rw Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:06 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 Jul 23 03:27:06 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:06 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1" returned: 0 in 0.279s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-8d03644d-637e-4226-99c7-c8a11d3cddc1" released by "_copy_volume_from_snapshot" :: held 7.146s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-a56f51b1-819c-4f33-80fd-99413f0b6e9e-8d03644d-637e-4226-99c7-c8a11d3cddc1" released by "_create_volume_from_snapshot" :: held 7.190s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.222s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.513s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-950295761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ec9fb0-d90d-4b0d-928a-50252885d49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba075c0815f4341815f1dc31456eb59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:00Z,use_quota=True,user_id='8e6f35e2d51f4b03b390c535f9d9b942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bf173c7-f565-425e-99f3-53abd5ee46ac),volume_type_id=8bf173c7-f565-425e-99f3-53abd5ee46ac)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Creating volume 18ec9fb0-d90d-4b0d-928a-50252885d49b {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:06 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:06 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b 1073741824 Jul 23 03:27:06 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b78439-8149-4b40-8c7e-79ca9959f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d03644d-637e-4226-99c7-c8a11d3cddc1', 'volume_size': 2, 'snapshot_id': 'a56f51b1-819c-4f33-80fd-99413f0b6e9e'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa2972e-7fe7-41eb-9e92-f0ad357c609d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:06 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Volume volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 (8d03644d-637e-4226-99c7-c8a11d3cddc1): created successfully Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aa2972e-7fe7-41eb-9e92-f0ad357c609d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Flow 'volume_create_manager' (9c5637e1-dd25-4ae4-817d-1d1243ad6746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:06 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-00e78bcf-b236-4bab-9d9d-b1a05a6afc0d req-64d19376-0832-48a7-8f81-69b503aad9fe tempest-TestStampPattern-886894386 None] Terminate volume connection completed successfully. Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-00e78bcf-b236-4bab-9d9d-b1a05a6afc0d req-64d19376-0832-48a7-8f81-69b503aad9fe tempest-TestStampPattern-886894386 None] Deleting attachment 194335e2-21af-4c90-9d97-0bfb1b137b75. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:27:06 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-111d9063-6597-4fb7-9bfe-5d00ee2abb4d tempest-VolumesSnapshotTestJSON-769971426 None] Created volume successfully. Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:06 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:27:06 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:07 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b 1073741824" returned: 0 in 0.611s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:07 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b Jul 23 03:27:07 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-8d03644d-637e-4226-99c7-c8a11d3cddc1-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-8d03644d-637e-4226-99c7-c8a11d3cddc1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:07 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.407s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-8d03644d-637e-4226-99c7-c8a11d3cddc1" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-8d03644d-637e-4226-99c7-c8a11d3cddc1" acquired by "delete_volume" :: waited 0.035s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f587851-dd26-4ec8-a3b1-28e4a0787de0]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:07 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:07 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:07 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b" returned: 0 in 0.470s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.053s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] Creating offline snapshot 77b63e86-b4b7-463e-aac7-26f1df5ec774 of volume 5cae1010-068b-4c49-ba92-41614dcbcbcf {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9056db6c-f93b-4df0-ba62-a63695cdd21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ec9fb0-d90d-4b0d-928a-50252885d49b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10adbbb3-beb8-4152-aaa6-0c968b546a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fb5c34-8c51-4a3a-8520-605adb804393]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:07 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Volume volume-18ec9fb0-d90d-4b0d-928a-50252885d49b (18ec9fb0-d90d-4b0d-928a-50252885d49b): created successfully Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10adbbb3-beb8-4152-aaa6-0c968b546a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Flow 'volume_create_manager' (1b3a62f0-2234-4a02-a6eb-56f5ca8e5721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:07 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d374e0a6-bedf-4923-b528-270634f8db78 tempest-VolumeTypesAccessTest-154850259 None] Created volume successfully. Jul 23 03:27:07 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf Jul 23 03:27:07 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:07 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1" returned: 0 in 0.456s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:07 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1 Jul 23 03:27:07 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:08 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d03644d-637e-4226-99c7-c8a11d3cddc1" returned: 0 in 0.267s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:08 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf" returned: 0 in 0.438s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-8d03644d-637e-4226-99c7-c8a11d3cddc1" released by "delete_volume" :: held 0.787s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:08 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 1G Jul 23 03:27:08 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Created reservations ['3143fc0d-6027-45d5-a165-65e520fa5525', 'bc1f32b0-2db5-4b60-8d61-a12add7192f5', 'e28f59ac-4ce9-4662-8d15-7bd9cf100989', 'c3f8675c-9485-45aa-902b-2e644274368e'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:08 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:27:08 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-a56f51b1-819c-4f33-80fd-99413f0b6e9e-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-a56f51b1-819c-4f33-80fd-99413f0b6e9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-311b7cab-1200-484a-88f4-afa276ad48a3" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:08 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.335s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-311b7cab-1200-484a-88f4-afa276ad48a3" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-a56f51b1-819c-4f33-80fd-99413f0b6e9e" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:08 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Deleted volume successfully. Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-a56f51b1-819c-4f33-80fd-99413f0b6e9e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Deleting offline snapshot a56f51b1-819c-4f33-80fd-99413f0b6e9e of volume 311b7cab-1200-484a-88f4-afa276ad48a3 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] snapshot_file for this snap is: volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c0316e4b-26b3-4221-a86c-fe3bd23bbd6a tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-8d03644d-637e-4226-99c7-c8a11d3cddc1-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bd9b6e-7fc9-447b-a647-416b27f51952]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:08 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 1G" returned: 0 in 0.565s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cae1010-068b-4c49-ba92-41614dcbcbcf -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:08 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cae1010-068b-4c49-ba92-41614dcbcbcf -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 Jul 23 03:27:08 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Acquiring lock "cinder-18ec9fb0-d90d-4b0d-928a-50252885d49b-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:08 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Lock "cinder-18ec9fb0-d90d-4b0d-928a-50252885d49b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:08 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Acquiring lock "cinder-quobyte-18ec9fb0-d90d-4b0d-928a-50252885d49b" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Lock "cinder-quobyte-18ec9fb0-d90d-4b0d-928a-50252885d49b" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[491c2c2f-f277-4a25-b244-7dd1b4283e25]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:09 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b Jul 23 03:27:09 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:09 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cae1010-068b-4c49-ba92-41614dcbcbcf -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774" returned: 0 in 0.391s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:09 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 is being set with open permissions: ugo+rw Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:09 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 Jul 23 03:27:09 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:09 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e" returned: 0 in 0.445s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-311b7cab-1200-484a-88f4-afa276ad48a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c16caaf-dd50-4901-9327-87e01e19aa1f]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:09 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 Jul 23 03:27:09 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:09 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b" returned: 0 in 0.474s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:09 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774" returned: 0 in 0.330s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:09 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b Jul 23 03:27:09 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:09 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.info Jul 23 03:27:09 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:09 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3" returned: 0 in 0.518s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:09 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-18ec9fb0-d90d-4b0d-928a-50252885d49b" returned: 0 in 0.303s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Lock "cinder-quobyte-18ec9fb0-d90d-4b0d-928a-50252885d49b" released by "delete_volume" :: held 0.832s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:09 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e Jul 23 03:27:09 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:09 devstack cinder-volume[88392]: WARNING cinder.quota [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1385649421 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1385649421, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:27:09 devstack cinder-volume[88392]: WARNING cinder.quota [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1385649421 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1385649421, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Created reservations ['d2316e46-76e5-4362-a978-bd27f374d17b', '02dc8b4e-53f4-4ad1-b724-b96add0faef7', 'a7b8dbe6-68d3-4db0-8ee5-6a2b68e6677e', 'cde437e1-f841-406d-8ccf-863f59ce14b3'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:09 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.info" returned: 0 in 0.355s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:09 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.info is being set with open permissions: ugo+rw Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:09 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.info Jul 23 03:27:09 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:09 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:27:09 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:10 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e" returned: 0 in 0.544s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:10 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.info" returned: 0 in 0.442s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:10 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e Jul 23 03:27:10 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.660s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:10 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.438s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:10 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d66e6358-7bfd-4558-a003-bd01bf68bd0c tempest-TestStampPattern-886894386 None] Create snapshot completed successfully Jul 23 03:27:10 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Deleted volume successfully. Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e0526d12-f92b-4392-a39c-0224a8423f91 tempest-VolumeTypesAccessTest-154850259 None] Lock "cinder-18ec9fb0-d90d-4b0d-928a-50252885d49b-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:10 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3.a56f51b1-819c-4f33-80fd-99413f0b6e9e" returned: 0 in 0.324s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-a56f51b1-819c-4f33-80fd-99413f0b6e9e" released by "_delete_snapshot" :: held 1.955s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-311b7cab-1200-484a-88f4-afa276ad48a3" released by "delete_snapshot" :: held 1.991s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Created reservations ['fd29b213-8ee8-4ef4-aa5a-1ebf55450d97', 'c059adf6-ef9b-4741-8112-f15cc4b2261d', 'fda086b2-c4f1-4f7e-b94c-38ef51e30839', '058193fa-a994-4393-bcee-6fcfb1b4a813'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:10 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Delete snapshot completed successfully. Jul 23 03:27:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-72cd00a7-53a0-4be7-b569-613432f942f3 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-a56f51b1-819c-4f33-80fd-99413f0b6e9e-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-311b7cab-1200-484a-88f4-afa276ad48a3-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-311b7cab-1200-484a-88f4-afa276ad48a3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-311b7cab-1200-484a-88f4-afa276ad48a3" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-311b7cab-1200-484a-88f4-afa276ad48a3" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:12 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f391b87e-e5ea-46fb-8cef-d688228a44a7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:12 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 Jul 23 03:27:12 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:12 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3" returned: 0 in 0.590s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:12 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3 Jul 23 03:27:12 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:13 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-311b7cab-1200-484a-88f4-afa276ad48a3" returned: 0 in 0.326s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-311b7cab-1200-484a-88f4-afa276ad48a3" released by "delete_volume" :: held 1.077s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Created reservations ['faf4926b-c603-477a-81d4-4f0ac15d2749', 'dfcf53f0-bb8c-4e2a-b942-23e43f5e8815', 'bfe7315b-681e-4c44-884e-01cf308006f0', 'bee97aea-1ecb-4f65-be9b-c67f5cba67aa'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:13 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:27:13 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:13 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.364s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Deleted volume successfully. Jul 23 03:27:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9c58b533-6d6a-44bf-9684-882fa4151aba tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-311b7cab-1200-484a-88f4-afa276ad48a3-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Flow 'volume_create_manager' (5cc79ab1-a106-47d3-ab51-611411e27e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cecce6-3d75-456b-a23c-425d02e57c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cecce6-3d75-456b-a23c-425d02e57c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-311634171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b37c65-26b1-4cbb-ace9-2a99bc5101a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58bb57f8aee4e87814f9995ef99c0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:15Z,use_quota=True,user_id='717d929a025a40fb8f8d4befa09ae065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626ec03c-17d4-4361-968d-b68219d930c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626ec03c-17d4-4361-968d-b68219d930c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bf8d2b-35bd-4558-bcf8-81eec37c0de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bf8d2b-35bd-4558-bcf8-81eec37c0de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b37c65-26b1-4cbb-ace9-2a99bc5101a7', 'volume_name': 'volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34b62a5-ffe7-48f0-8d5a-d5295b50d43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34b62a5-ffe7-48f0-8d5a-d5295b50d43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b9fc9c-2d9b-410e-8e6a-53556715d0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:15 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Volume 74b37c65-26b1-4cbb-ace9-2a99bc5101a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7', 'volume_size': 1} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-311634171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b37c65-26b1-4cbb-ace9-2a99bc5101a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58bb57f8aee4e87814f9995ef99c0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:15Z,use_quota=True,user_id='717d929a025a40fb8f8d4befa09ae065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Creating volume 74b37c65-26b1-4cbb-ace9-2a99bc5101a7 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:15 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:15 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 1073741824 Jul 23 03:27:15 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:15 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 1073741824" returned: 0 in 0.708s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:15 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 Jul 23 03:27:15 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:16 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" returned: 0 in 0.277s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b9fc9c-2d9b-410e-8e6a-53556715d0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f35235-06e2-43de-babd-439d66543961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:16 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Volume volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 (74b37c65-26b1-4cbb-ace9-2a99bc5101a7): created successfully Jul 23 03:27:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f35235-06e2-43de-babd-439d66543961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Flow 'volume_create_manager' (5cc79ab1-a106-47d3-ab51-611411e27e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0844bbad-a21c-4e14-a3a1-8029bb72a7d0 tempest-VolumesSnapshotTestJSON-769971426 None] Created volume successfully. Jul 23 03:27:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] Creating offline snapshot 05bdfd8a-3907-477f-91b2-e99e252d3a69 of volume 74b37c65-26b1-4cbb-ace9-2a99bc5101a7 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:27:17 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cade09a-8155-4a6f-ae45-3fc278be4c11]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:17 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 Jul 23 03:27:17 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:18 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" returned: 0 in 0.778s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:18 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 1G Jul 23 03:27:18 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:19 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 1G" returned: 0 in 0.887s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:19 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 Jul 23 03:27:19 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:19 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69" returned: 0 in 0.574s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:19 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 is being set with open permissions: ugo+rw Jul 23 03:27:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:19 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 Jul 23 03:27:19 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:20 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69" returned: 0 in 0.381s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=168,cinder:SELECT=124,cinder:INSERT=35,cinder:DELETE=13 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:20 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.info Jul 23 03:27:20 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:20 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.info" returned: 0 in 0.458s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:20 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.info is being set with open permissions: ugo+rw Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:20 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.info Jul 23 03:27:20 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Flow 'volume_create_manager' (d996f141-9c39-4083-bd0f-bfcde3328c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926c442a-1561-438e-a54a-a2605ddb61d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926c442a-1561-438e-a54a-a2605ddb61d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-616054062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c1a8ac-6f76-4279-93d2-b2461f1d4e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ba52489e77478499c1406259fb360b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=77b63e86-b4b7-463e-aac7-26f1df5ec774,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:21Z,use_quota=True,user_id='b56b436303a547a69748d2dec3dd3e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784de271-2fd8-4222-b7f1-9bdb8bac7a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784de271-2fd8-4222-b7f1-9bdb8bac7a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cc8d85-a438-4d97-8e01-e01a1ff1c041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cc8d85-a438-4d97-8e01-e01a1ff1c041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '70c1a8ac-6f76-4279-93d2-b2461f1d4e05', 'volume_name': 'volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05', 'volume_size': 1, 'snapshot_id': '77b63e86-b4b7-463e-aac7-26f1df5ec774'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031e5d26-9d3d-4ca8-93ab-481f37112e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031e5d26-9d3d-4ca8-93ab-481f37112e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626b16de-0ab1-4a53-96a4-88e4dfee57e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:20 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Volume 70c1a8ac-6f76-4279-93d2-b2461f1d4e05: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05', 'volume_size': 1, 'snapshot_id': '77b63e86-b4b7-463e-aac7-26f1df5ec774'} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:20 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.info" returned: 0 in 0.344s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.573s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.160s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Acquiring lock "cinder-quobyte-77b63e86-b4b7-463e-aac7-26f1df5ec774-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" by "_create_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-77b63e86-b4b7-463e-aac7-26f1df5ec774-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Creating volume 70c1a8ac-6f76-4279-93d2-b2461f1d4e05 from snapshot 77b63e86-b4b7-463e-aac7-26f1df5ec774 {{(pid=88392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Acquiring lock "cinder-quobyte-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:20 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a9668b74-464d-4cf8-8cbd-bcf800b12cc5 tempest-VolumesSnapshotTestJSON-769971426 None] Create snapshot completed successfully Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] snapshot: 77b63e86-b4b7-463e-aac7-26f1df5ec774, volume: 70c1a8ac-6f76-4279-93d2-b2461f1d4e05, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f48d1f-c6aa-479d-b3e8-8cbf5836985e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:21 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 Jul 23 03:27:21 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:21 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774" returned: 0 in 0.492s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cae1010-068b-4c49-ba92-41614dcbcbcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ed3c12-ff81-497d-b38d-308bf171898a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:21 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf Jul 23 03:27:21 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:22 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf" returned: 0 in 0.764s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:22 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 Jul 23 03:27:22 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Flow 'volume_create_manager' (f93fd8d2-431a-44dd-b0c6-4380d5656be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4316f6-3e1f-47a9-a089-077636bd6936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4316f6-3e1f-47a9-a089-077636bd6936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-405538860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d65d31f-b109-427d-b31a-f1a7e3c931ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58bb57f8aee4e87814f9995ef99c0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05bdfd8a-3907-477f-91b2-e99e252d3a69,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:22Z,use_quota=True,user_id='717d929a025a40fb8f8d4befa09ae065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca72147-0c5b-4d74-aae4-1b10d82510ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca72147-0c5b-4d74-aae4-1b10d82510ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d7780a-9131-4f8c-9b3d-c31d7094ec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d7780a-9131-4f8c-9b3d-c31d7094ec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d65d31f-b109-427d-b31a-f1a7e3c931ea', 'volume_name': 'volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea', 'volume_size': 1, 'snapshot_id': '05bdfd8a-3907-477f-91b2-e99e252d3a69'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439eac0f-cf76-4855-aa8a-0e97f51d55d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439eac0f-cf76-4855-aa8a-0e97f51d55d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b0ecab-d023-4ea6-b051-42ba2cd22a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:22 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Volume 8d65d31f-b109-427d-b31a-f1a7e3c931ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea', 'volume_size': 1, 'snapshot_id': '05bdfd8a-3907-477f-91b2-e99e252d3a69'} Jul 23 03:27:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:28 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" returned: 0 in 6.336s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:28 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb919ea-b5f9-40d5-bdaf-b5fead20f1c1]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:28 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf Jul 23 03:27:28 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:29 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf" returned: 0 in 0.685s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:27:29 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Converted 1024.00 MB image at 161.58 MB/s Jul 23 03:27:29 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 is being set with open permissions: ugo+rw Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:29 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 Jul 23 03:27:29 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:29 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" returned: 0 in 0.429s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" released by "_copy_volume_from_snapshot" :: held 8.860s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-77b63e86-b4b7-463e-aac7-26f1df5ec774-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" released by "_create_volume_from_snapshot" :: held 8.908s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.938s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.223s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-05bdfd8a-3907-477f-91b2-e99e252d3a69-8d65d31f-b109-427d-b31a-f1a7e3c931ea" by "_create_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-05bdfd8a-3907-477f-91b2-e99e252d3a69-8d65d31f-b109-427d-b31a-f1a7e3c931ea" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Creating volume 8d65d31f-b109-427d-b31a-f1a7e3c931ea from snapshot 05bdfd8a-3907-477f-91b2-e99e252d3a69 {{(pid=88392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-8d65d31f-b109-427d-b31a-f1a7e3c931ea" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626b16de-0ab1-4a53-96a4-88e4dfee57e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05', 'volume_size': 1, 'snapshot_id': '77b63e86-b4b7-463e-aac7-26f1df5ec774'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642b9490-0a93-41f7-a770-be0fd1d67bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-8d65d31f-b109-427d-b31a-f1a7e3c931ea" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] snapshot: 05bdfd8a-3907-477f-91b2-e99e252d3a69, volume: 8d65d31f-b109-427d-b31a-f1a7e3c931ea, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:27:29 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=132,cinder:INSERT=36,cinder:UPDATE=126,cinder:DELETE=14 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:27:30 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Volume volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 (70c1a8ac-6f76-4279-93d2-b2461f1d4e05): created successfully Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642b9490-0a93-41f7-a770-be0fd1d67bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Flow 'volume_create_manager' (d996f141-9c39-4083-bd0f-bfcde3328c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c91c3f-b59d-497f-bb76-f26636c28077]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3408e63b-e871-46a0-8e9b-d05f5c81a6b9 tempest-TestStampPattern-886894386 None] Created volume successfully. Jul 23 03:27:30 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 Jul 23 03:27:30 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:30 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69" returned: 0 in 0.642s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a465df20-c48f-47f7-9f0f-8498606a3bd2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:30 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 Jul 23 03:27:30 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:31 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" returned: 0 in 0.510s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:31 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:27:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:31 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea Jul 23 03:27:31 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:36 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea" returned: 0 in 5.531s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:36 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5063316c-fbc2-4271-9b97-13d3d8fef775]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:36 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 Jul 23 03:27:36 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Flow 'volume_create_manager' (dc96b38f-9338-406b-a017-44c7550900a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:37 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca2279d-6b96-4211-a2e6-6ad8e76300aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" returned: 0 in 0.762s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:27:37 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Converted 1024.00 MB image at 185.09 MB/s Jul 23 03:27:37 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea is being set with open permissions: ugo+rw Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca2279d-6b96-4211-a2e6-6ad8e76300aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1460273158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d90ec1-84a1-40bf-94ef-7950246613a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ea9891d4b540eb996b88da2f8e921b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:37Z,use_quota=True,user_id='769ab944ae914362bbb7c930b3e0f103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:37 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea Jul 23 03:27:37 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8ae19b-0b67-41fa-9e27-0c5fb6ace48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8ae19b-0b67-41fa-9e27-0c5fb6ace48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507db739-f150-42e4-9cc8-ed8ceb5077cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507db739-f150-42e4-9cc8-ed8ceb5077cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0d90ec1-84a1-40bf-94ef-7950246613a4', 'volume_name': 'volume-a0d90ec1-84a1-40bf-94ef-7950246613a4', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4ad755-68ad-4769-bded-dbc56a17dafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4ad755-68ad-4769-bded-dbc56a17dafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a78b47-6c86-45cd-9c18-837513638d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:37 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Volume a0d90ec1-84a1-40bf-94ef-7950246613a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0d90ec1-84a1-40bf-94ef-7950246613a4', 'volume_size': 1} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:37 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea" returned: 0 in 0.303s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-8d65d31f-b109-427d-b31a-f1a7e3c931ea" released by "_copy_volume_from_snapshot" :: held 7.920s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-05bdfd8a-3907-477f-91b2-e99e252d3a69-8d65d31f-b109-427d-b31a-f1a7e3c931ea" released by "_create_volume_from_snapshot" :: held 7.993s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.045s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.261s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1460273158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d90ec1-84a1-40bf-94ef-7950246613a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6ea9891d4b540eb996b88da2f8e921b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:37Z,use_quota=True,user_id='769ab944ae914362bbb7c930b3e0f103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Creating volume a0d90ec1-84a1-40bf-94ef-7950246613a4 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:37 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:37 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 1073741824 Jul 23 03:27:37 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b0ecab-d023-4ea6-b051-42ba2cd22a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea', 'volume_size': 1, 'snapshot_id': '05bdfd8a-3907-477f-91b2-e99e252d3a69'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfdcdf3-2e6a-46d4-ad2f-777856d987fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:38 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Volume volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea (8d65d31f-b109-427d-b31a-f1a7e3c931ea): created successfully Jul 23 03:27:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfdcdf3-2e6a-46d4-ad2f-777856d987fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Flow 'volume_create_manager' (f93fd8d2-431a-44dd-b0c6-4380d5656be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:38 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1cdeb82b-7f08-4057-9f1b-035100fac058 tempest-VolumesSnapshotTestJSON-769971426 None] Created volume successfully. Jul 23 03:27:38 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 1073741824" returned: 0 in 0.604s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:38 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 Jul 23 03:27:38 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-8d65d31f-b109-427d-b31a-f1a7e3c931ea-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-8d65d31f-b109-427d-b31a-f1a7e3c931ea-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-8d65d31f-b109-427d-b31a-f1a7e3c931ea" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-8d65d31f-b109-427d-b31a-f1a7e3c931ea" acquired by "delete_volume" :: waited 0.033s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:38 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c2842e-5eab-483d-8a66-077ee1eb578d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:39 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4" returned: 0 in 0.458s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a78b47-6c86-45cd-9c18-837513638d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0d90ec1-84a1-40bf-94ef-7950246613a4', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed19f63-7638-43dc-8e80-5b508e786e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Volume volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 (a0d90ec1-84a1-40bf-94ef-7950246613a4): created successfully Jul 23 03:27:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed19f63-7638-43dc-8e80-5b508e786e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Flow 'volume_create_manager' (dc96b38f-9338-406b-a017-44c7550900a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:39 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea Jul 23 03:27:39 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0e9c5f22-9f33-40f2-9b1b-37efbeb93b7c tempest-VolumesActionsTest-2047332385 None] Created volume successfully. Jul 23 03:27:39 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea" returned: 0 in 0.564s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:39 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea Jul 23 03:27:39 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:39 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8d65d31f-b109-427d-b31a-f1a7e3c931ea" returned: 0 in 0.458s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-8d65d31f-b109-427d-b31a-f1a7e3c931ea" released by "delete_volume" :: held 1.092s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:40 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Created reservations ['d803647f-5ab2-4ed4-bf9a-56f46adfc788', '274d4fcf-d3af-4a59-b169-f60425c52f0a', '3b22c1dc-6858-4b3f-bf9c-75734a61bcc6', '4d042d26-ffff-4d61-a889-055865354542'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:40 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:27:40 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:40 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.358s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:40 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:40 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Deleted volume successfully. Jul 23 03:27:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1c630151-6d8a-4feb-94da-20533bcba137 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-8d65d31f-b109-427d-b31a-f1a7e3c931ea-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-05bdfd8a-3907-477f-91b2-e99e252d3a69-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-05bdfd8a-3907-477f-91b2-e99e252d3a69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-05bdfd8a-3907-477f-91b2-e99e252d3a69" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-05bdfd8a-3907-477f-91b2-e99e252d3a69" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Deleting offline snapshot 05bdfd8a-3907-477f-91b2-e99e252d3a69 of volume 74b37c65-26b1-4cbb-ace9-2a99bc5101a7 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:27:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] snapshot_file for this snap is: volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:27:41 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47a1b8a-b296-4bd3-9f71-3317853713ff]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:41 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 Jul 23 03:27:41 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:42 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69" returned: 0 in 0.706s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:27:42 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a992271-2d75-4c37-8bbc-d3e57b614d93]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:42 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 Jul 23 03:27:42 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:42 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" returned: 0 in 0.650s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:42 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 Jul 23 03:27:42 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:43 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69" returned: 0 in 0.668s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:43 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69 Jul 23 03:27:43 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:43 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7.05bdfd8a-3907-477f-91b2-e99e252d3a69" returned: 0 in 0.516s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-05bdfd8a-3907-477f-91b2-e99e252d3a69" released by "_delete_snapshot" :: held 2.763s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" released by "delete_snapshot" :: held 2.796s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:44 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Created reservations ['14bf8c08-00c1-4a5b-a561-d35a774a3262', 'f0a4c8ce-0205-4674-a8cd-09fb6404ea67', '3bc3593a-15c4-4344-85a6-018199407ddf', '8706b61a-885d-47dd-8fb6-b365705bcea3'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Delete snapshot completed successfully. Jul 23 03:27:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3994bad2-87f9-4ce7-82eb-f05c6880f3bb tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-05bdfd8a-3907-477f-91b2-e99e252d3a69-delete_snapshot" released by "delete_snapshot" :: held 3.152s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-74b37c65-26b1-4cbb-ace9-2a99bc5101a7-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-74b37c65-26b1-4cbb-ace9-2a99bc5101a7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:44 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4ca23d-1141-4d00-a04f-8681bcc3ef4f]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:45 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 Jul 23 03:27:45 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:45 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" returned: 0 in 0.903s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:45 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7 Jul 23 03:27:45 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:46 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" returned: 0 in 0.398s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-74b37c65-26b1-4cbb-ace9-2a99bc5101a7" released by "delete_volume" :: held 1.438s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Created reservations ['5e0998e2-16a8-4e17-b39f-72686cad3792', '3c3b32ea-db9c-465b-b96e-cb1d5e313a48', '0c2c6e00-4f49-4069-ab11-6a34ed204602', 'ed8a6968-5db8-4fdd-a0cc-58f19bdebf67'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:46 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:27:46 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:46 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.347s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Deleted volume successfully. Jul 23 03:27:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f78d07ec-1f54-498a-95da-11cebe68a0de tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-74b37c65-26b1-4cbb-ace9-2a99bc5101a7-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "cinder-quobyte-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:47 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6e85cc-feb2-4dd1-982e-36b113d2c6e8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:27:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:47 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f Jul 23 03:27:47 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:48 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f" returned: 0 in 0.608s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:48 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f Jul 23 03:27:48 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:48 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f" returned: 0 in 0.504s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-quobyte-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f" released by "delete_volume" :: held 1.252s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:48 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Created reservations ['fc36e700-6703-421b-b06b-754aa80dcc57', 'a2877024-636f-4fef-84c6-95e283eba3bf', '05bb16e0-659c-4401-ab51-5ab6d94ee901', '0e336498-eb45-4c72-b50a-11ca3ac6d419'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:27:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:49 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:27:49 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:49 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.612s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:49 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:27:49 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Deleted volume successfully. Jul 23 03:27:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f077c6b-97fa-4615-8bfe-73a321f83f47 tempest-VolumesSnapshotTestJSON-769971426 None] Lock "cinder-0b85e302-fa3f-48d8-b4b6-adc1e178bb4f-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2186c259-7ef3-4c4b-b85a-19bc9f64dbd9 tempest-VolumesActionsTest-2047332385 None] Acquiring lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4" by "attach_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2186c259-7ef3-4c4b-b85a-19bc9f64dbd9 tempest-VolumesActionsTest-2047332385 None] Lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4" acquired by "attach_volume" :: waited 0.034s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:56 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2186c259-7ef3-4c4b-b85a-19bc9f64dbd9 tempest-VolumesActionsTest-2047332385 None] Attaching volume a0d90ec1-84a1-40bf-94ef-7950246613a4 to instance 1f1743b7-095c-4350-b180-51a2a3f0b529 at mountpoint /dev/vdb on host None. Jul 23 03:27:56 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2186c259-7ef3-4c4b-b85a-19bc9f64dbd9 tempest-VolumesActionsTest-2047332385 None] Attach volume completed successfully. Jul 23 03:27:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2186c259-7ef3-4c4b-b85a-19bc9f64dbd9 tempest-VolumesActionsTest-2047332385 None] Lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4" released by "attach_volume" :: held 0.139s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-476affbb-c455-4ca0-bdcf-ccca898050fd tempest-VolumesActionsTest-2047332385 None] Acquiring lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4-detach_volume" by "detach_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:27:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-476affbb-c455-4ca0-bdcf-ccca898050fd tempest-VolumesActionsTest-2047332385 None] Lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:27:57 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-476affbb-c455-4ca0-bdcf-ccca898050fd tempest-VolumesActionsTest-2047332385 None] Detaching volume a0d90ec1-84a1-40bf-94ef-7950246613a4 from instance 1f1743b7-095c-4350-b180-51a2a3f0b529. Jul 23 03:27:57 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-476affbb-c455-4ca0-bdcf-ccca898050fd tempest-VolumesActionsTest-2047332385 None] Detach volume completed successfully. Jul 23 03:27:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-476affbb-c455-4ca0-bdcf-ccca898050fd tempest-VolumesActionsTest-2047332385 None] Lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Flow 'volume_create_manager' (c52d0a12-22ad-49f8-94ea-3e1c039e2752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21572c1a-1984-48cd-9af1-4733832f19a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21572c1a-1984-48cd-9af1-4733832f19a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1667288829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b6f05e-017c-46d1-89f9-b2d20d0938bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8147f8092bd94d3bb8447c7ae303847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:58Z,use_quota=True,user_id='cc3b0eed81a54baab1d609fe12b44553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5307c3c1-ecdd-4768-ac31-7733343a1ef6),volume_type_id=5307c3c1-ecdd-4768-ac31-7733343a1ef6)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d975f3e5-fde8-4ace-b13d-8bce2cc947c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d975f3e5-fde8-4ace-b13d-8bce2cc947c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0ddb06-b7b1-4d00-9523-c345f1a20f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0ddb06-b7b1-4d00-9523-c345f1a20f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0b6f05e-017c-46d1-89f9-b2d20d0938bd', 'volume_name': 'volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86db97dd-0ff9-49cd-88c6-73550d0adc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86db97dd-0ff9-49cd-88c6-73550d0adc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3926300a-b75d-485d-a52d-bf5e1506bb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:58 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Volume e0b6f05e-017c-46d1-89f9-b2d20d0938bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd', 'volume_size': 1} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1667288829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b6f05e-017c-46d1-89f9-b2d20d0938bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8147f8092bd94d3bb8447c7ae303847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:58Z,use_quota=True,user_id='cc3b0eed81a54baab1d609fe12b44553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5307c3c1-ecdd-4768-ac31-7733343a1ef6),volume_type_id=5307c3c1-ecdd-4768-ac31-7733343a1ef6)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Creating volume e0b6f05e-017c-46d1-89f9-b2d20d0938bd {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:58 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:58 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd 1073741824 Jul 23 03:27:58 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:58 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Flow 'volume_create_manager' (f7e66d50-71e0-4b00-9ed0-3e6e7277d271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72968180-91b9-449e-a676-4df451612551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72968180-91b9-449e-a676-4df451612551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-904875499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1556a74d-7c45-4966-b322-77244a2988c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8147f8092bd94d3bb8447c7ae303847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:59Z,use_quota=True,user_id='cc3b0eed81a54baab1d609fe12b44553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7425e0dd-93a9-47ae-81b9-be29928b9b92),volume_type_id=7425e0dd-93a9-47ae-81b9-be29928b9b92)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5547dc7-f6d4-4f76-b314-2da2eb2d227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5547dc7-f6d4-4f76-b314-2da2eb2d227c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2400b38f-02d1-4328-a2a6-c12d743d9bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2400b38f-02d1-4328-a2a6-c12d743d9bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1556a74d-7c45-4966-b322-77244a2988c5', 'volume_name': 'volume-1556a74d-7c45-4966-b322-77244a2988c5', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b22859-b04f-481b-aefb-7883987a6fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b22859-b04f-481b-aefb-7883987a6fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391a9534-5bd4-4928-9834-846c84e03040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:59 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Volume 1556a74d-7c45-4966-b322-77244a2988c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1556a74d-7c45-4966-b322-77244a2988c5', 'volume_size': 1} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:59 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd 1073741824" returned: 0 in 0.915s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:59 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd Jul 23 03:27:59 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:59 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd" returned: 0 in 0.421s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.499s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-904875499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1556a74d-7c45-4966-b322-77244a2988c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8147f8092bd94d3bb8447c7ae303847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:27:59Z,use_quota=True,user_id='cc3b0eed81a54baab1d609fe12b44553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7425e0dd-93a9-47ae-81b9-be29928b9b92),volume_type_id=7425e0dd-93a9-47ae-81b9-be29928b9b92)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Creating volume 1556a74d-7c45-4966-b322-77244a2988c5 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:27:59 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3926300a-b75d-485d-a52d-bf5e1506bb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:59 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5 1073741824 Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc991677-037a-4296-bb2c-58d2c5063cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:59 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:27:59 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Volume volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd (e0b6f05e-017c-46d1-89f9-b2d20d0938bd): created successfully Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc991677-037a-4296-bb2c-58d2c5063cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Flow 'volume_create_manager' (c52d0a12-22ad-49f8-94ea-3e1c039e2752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:59 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9b97eab8-3daf-465d-8d0a-51e6ddefea95 tempest-TestInstancesWithCinderVolumes-540871461 None] Created volume successfully. Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Flow 'volume_create_manager' (6aa40192-e774-43b8-aec8-28f895ee4943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f359862f-88b7-400c-9043-c6b2a4f94ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f359862f-88b7-400c-9043-c6b2a4f94ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-954761329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78df38d-8042-4e13-ba44-28010766afb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8147f8092bd94d3bb8447c7ae303847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:00Z,use_quota=True,user_id='cc3b0eed81a54baab1d609fe12b44553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9f3219c-3134-42ea-aebe-5e2158b8e2c1),volume_type_id=d9f3219c-3134-42ea-aebe-5e2158b8e2c1)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae70afa-9b37-4c6f-b328-5eb1064f59b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae70afa-9b37-4c6f-b328-5eb1064f59b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70bd9133-67a3-4d7a-9bae-f8be73559323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:27:59 devstack cinder-volume[88392]: DEBUG cinder.image.glance [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Creating Keystone auth plugin from conf {{(pid=88392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70bd9133-67a3-4d7a-9bae-f8be73559323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b78df38d-8042-4e13-ba44-28010766afb2', 'volume_name': 'volume-b78df38d-8042-4e13-ba44-28010766afb2', 'volume_size': 1, 'image_id': '9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1586242040', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8147f8092bd94d3bb8447c7ae303847a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'created_at': datetime.datetime(2026, 7, 23, 1, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 27, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dfbc979-056e-45eb-b2ef-ce9f6d903b1c/file', 'properties': {}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6895dc-cb24-4015-947a-ae7940a09daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:00 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6895dc-cb24-4015-947a-ae7940a09daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7e1f56-498b-4ccb-8d9b-b5ac03d6e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:00 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Volume b78df38d-8042-4e13-ba44-28010766afb2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b78df38d-8042-4e13-ba44-28010766afb2', 'volume_size': 1, 'image_id': '9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1586242040', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8147f8092bd94d3bb8447c7ae303847a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'created_at': datetime.datetime(2026, 7, 23, 1, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 27, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dfbc979-056e-45eb-b2ef-ce9f6d903b1c/file', 'properties': {}}, 'image_service': } Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Trying to clone b78df38d-8042-4e13-ba44-28010766afb2 from image 9dfbc979-056e-45eb-b2ef-ce9f6d903b1c at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'metadata': {}}]). {{(pid=88392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5 1073741824" returned: 0 in 0.727s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:00 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5 Jul 23 03:28:00 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:00 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5" returned: 0 in 0.377s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391a9534-5bd4-4928-9834-846c84e03040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1556a74d-7c45-4966-b322-77244a2988c5', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633fa1cd-f64f-4ae8-9b98-4536581ed1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:00 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Volume volume-1556a74d-7c45-4966-b322-77244a2988c5 (1556a74d-7c45-4966-b322-77244a2988c5): created successfully Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633fa1cd-f64f-4ae8-9b98-4536581ed1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Flow 'volume_create_manager' (f7e66d50-71e0-4b00-9ed0-3e6e7277d271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:00 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7d50528c-f3ad-45eb-bc40-e484584b75b1 tempest-TestInstancesWithCinderVolumes-540871461 None] Created volume successfully. Jul 23 03:28:04 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD, size 20.69 MB, duration 3.98 sec {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:28:04 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Image download 20.69 MB at 5.20 MB/s Jul 23 03:28:04 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbfaef9-2a5b-4155-b4e4-80e34df89179]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:04 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD Jul 23 03:28:04 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:05 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Temporary image 9dfbc979-056e-45eb-b2ef-ce9f6d903b1c is fetched for user cc3b0eed81a54baab1d609fe12b44553. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f0f29a-10ec-46fd-9f01-08308f863446]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:05 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD Jul 23 03:28:05 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:05 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-954761329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78df38d-8042-4e13-ba44-28010766afb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8147f8092bd94d3bb8447c7ae303847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:28:00Z,use_quota=True,user_id='cc3b0eed81a54baab1d609fe12b44553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9f3219c-3134-42ea-aebe-5e2158b8e2c1),volume_type_id=d9f3219c-3134-42ea-aebe-5e2158b8e2c1)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Creating volume b78df38d-8042-4e13-ba44-28010766afb2 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:28:05 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:28:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:05 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 1073741824 Jul 23 03:28:05 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:06 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 1073741824" returned: 0 in 0.472s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:06 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 Jul 23 03:28:06 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:06 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2" returned: 0 in 0.324s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Attempting download of 9dfbc979-056e-45eb-b2ef-ce9f6d903b1c ((None, [{'url': 'file:///opt/stack/data/glance/images/9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'metadata': {}}])) to volume b78df38d-8042-4e13-ba44-28010766afb2. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fa241a-0ce3-4e35-95b9-cdb308a8c6cd]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_sbzip0st {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:06 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_sbzip0st Jul 23 03:28:06 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:06 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:28:06 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:06 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_sbzip0st" returned: 0 in 0.383s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_sbzip0st {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:07 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_sbzip0st Jul 23 03:28:07 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:07 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.310s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:28:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:28:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:28:07 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_sbzip0st" returned: 1 in 0.517s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_sbzip0st' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:28:07 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed61768c-7f50-4197-bed6-e5497b33f6b3]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:07 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD Jul 23 03:28:07 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:08 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD" returned: 0 in 0.694s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:08 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] 9dfbc979-056e-45eb-b2ef-ce9f6d903b1c was qcow2, converting to qcow2 {{(pid=88392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:28:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:08 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 Jul 23 03:28:08 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:11 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2" returned: 0 in 2.934s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dfbc979-056e-45eb-b2ef-ce9f6d903b1c_71isqlsbdevstack@QuobyteHD, size 112.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:28:11 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Converted 112.00 MB image at 38.16 MB/s Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:11 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 1G Jul 23 03:28:11 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:11 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 1G" returned: 0 in 0.519s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Downloaded image 9dfbc979-056e-45eb-b2ef-ce9f6d903b1c ((None, [{'url': 'file:///opt/stack/data/glance/images/9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'metadata': {}}])) to volume b78df38d-8042-4e13-ba44-28010766afb2 successfully. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Temporary image 9dfbc979-056e-45eb-b2ef-ce9f6d903b1c for user cc3b0eed81a54baab1d609fe12b44553 is deleted. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Marking volume b78df38d-8042-4e13-ba44-28010766afb2 as bootable. {{(pid=88392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1aaf46ad-934b-488e-8db7-0d6b31790f12 tempest-VolumesActionsTest-2047332385 None] Acquiring lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4" by "attach_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Copying metadata from image 9dfbc979-056e-45eb-b2ef-ce9f6d903b1c to b78df38d-8042-4e13-ba44-28010766afb2. {{(pid=88392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Creating volume glance metadata for volume b78df38d-8042-4e13-ba44-28010766afb2 backed by image 9dfbc979-056e-45eb-b2ef-ce9f6d903b1c with: {'image_id': '9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'image_name': 'tempest-scenario-img--1586242040', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1aaf46ad-934b-488e-8db7-0d6b31790f12 tempest-VolumesActionsTest-2047332385 None] Lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4" acquired by "attach_volume" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1aaf46ad-934b-488e-8db7-0d6b31790f12 tempest-VolumesActionsTest-2047332385 None] Attaching volume a0d90ec1-84a1-40bf-94ef-7950246613a4 to instance 17af1308-c4f1-4604-9047-7667a793fea9 at mountpoint /dev/vdb on host None. Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7e1f56-498b-4ccb-8d9b-b5ac03d6e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78df38d-8042-4e13-ba44-28010766afb2', 'volume_size': 1, 'image_id': '9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1586242040', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8147f8092bd94d3bb8447c7ae303847a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dfbc979-056e-45eb-b2ef-ce9f6d903b1c', 'created_at': datetime.datetime(2026, 7, 23, 1, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 27, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dfbc979-056e-45eb-b2ef-ce9f6d903b1c/file', 'properties': {}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f64ec41-1f94-4905-a7d7-3f03c073c383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:28:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1aaf46ad-934b-488e-8db7-0d6b31790f12 tempest-VolumesActionsTest-2047332385 None] Attach volume completed successfully. Jul 23 03:28:11 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Volume volume-b78df38d-8042-4e13-ba44-28010766afb2 (b78df38d-8042-4e13-ba44-28010766afb2): created successfully Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f64ec41-1f94-4905-a7d7-3f03c073c383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Flow 'volume_create_manager' (6aa40192-e774-43b8-aec8-28f895ee4943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:28:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1aaf46ad-934b-488e-8db7-0d6b31790f12 tempest-VolumesActionsTest-2047332385 None] Lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4" released by "attach_volume" :: held 0.159s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8b52d39b-94b2-4fa7-bed7-4785ff6444d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Created volume successfully. Jul 23 03:28:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5de3fd75-d1e4-4a28-83bd-b3e97a3377de tempest-VolumesActionsTest-2047332385 None] Acquiring lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4-detach_volume" by "detach_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5de3fd75-d1e4-4a28-83bd-b3e97a3377de tempest-VolumesActionsTest-2047332385 None] Lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:12 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5de3fd75-d1e4-4a28-83bd-b3e97a3377de tempest-VolumesActionsTest-2047332385 None] Detaching volume a0d90ec1-84a1-40bf-94ef-7950246613a4 from instance 17af1308-c4f1-4604-9047-7667a793fea9. Jul 23 03:28:12 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5de3fd75-d1e4-4a28-83bd-b3e97a3377de tempest-VolumesActionsTest-2047332385 None] Detach volume completed successfully. Jul 23 03:28:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5de3fd75-d1e4-4a28-83bd-b3e97a3377de tempest-VolumesActionsTest-2047332385 None] Lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-e50ef6af-470a-4560-a33a-492c30094f02 req-656c7f58-d892-454f-89f3-78e6ea86a3b2 tempest-TestStampPattern-886894386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-e50ef6af-470a-4560-a33a-492c30094f02 req-656c7f58-d892-454f-89f3-78e6ea86a3b2 tempest-TestStampPattern-886894386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:15 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae24916-bc4f-46e7-8bfc-cf0a2ce96b90]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-e50ef6af-470a-4560-a33a-492c30094f02 req-656c7f58-d892-454f-89f3-78e6ea86a3b2 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:15 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 Jul 23 03:28:15 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:16 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-e50ef6af-470a-4560-a33a-492c30094f02 req-656c7f58-d892-454f-89f3-78e6ea86a3b2 tempest-TestStampPattern-886894386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" returned: 0 in 0.516s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-e50ef6af-470a-4560-a33a-492c30094f02 req-656c7f58-d892-454f-89f3-78e6ea86a3b2 tempest-TestStampPattern-886894386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.576s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-e50ef6af-470a-4560-a33a-492c30094f02 req-656c7f58-d892-454f-89f3-78e6ea86a3b2 tempest-TestStampPattern-886894386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '637ff2f4-15c6-4dbe-a17a-2abe953e39f3', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:28:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-e50ef6af-470a-4560-a33a-492c30094f02 req-656c7f58-d892-454f-89f3-78e6ea86a3b2 tempest-TestStampPattern-886894386 None] attachment_update completed successfully. Jul 23 03:28:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-33b0d362-fb71-463d-b827-d1f9b1c01aeb req-398675e9-3c53-4775-b07c-a229740afe2c tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-33b0d362-fb71-463d-b827-d1f9b1c01aeb req-398675e9-3c53-4775-b07c-a229740afe2c tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-33b0d362-fb71-463d-b827-d1f9b1c01aeb req-398675e9-3c53-4775-b07c-a229740afe2c tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-33b0d362-fb71-463d-b827-d1f9b1c01aeb req-398675e9-3c53-4775-b07c-a229740afe2c tempest-TestInstancesWithCinderVolumes-540871461 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-b78df38d-8042-4e13-ba44-28010766afb2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c8f90c2-a738-4577-8a81-cd5b365a2ea7', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:28:18 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-33b0d362-fb71-463d-b827-d1f9b1c01aeb req-398675e9-3c53-4775-b07c-a229740afe2c tempest-TestInstancesWithCinderVolumes-540871461 None] attachment_update completed successfully. Jul 23 03:28:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:18 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1037430-ea5a-432f-9f61-82808d9d8477]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:18 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 Jul 23 03:28:18 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:19 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4" returned: 0 in 0.591s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:19 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[935f6c74-7932-4088-a521-e7f30bf9d765]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:19 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 Jul 23 03:28:19 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:19 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4" returned: 0 in 0.575s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.a704132e-062d-48b4-a836-3eb01b9342bdewac8_0u.img {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:19 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.a704132e-062d-48b4-a836-3eb01b9342bdewac8_0u.img Jul 23 03:28:19 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:21 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=60,cinder:SELECT=63,cinder:DELETE=7,cinder:INSERT=18 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:28:21 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-ab6f70fb-4c9f-4c86-a102-ed1f6db65117 req-7ac08cc1-28f9-4b27-819f-123a40c33af7 tempest-TestStampPattern-886894386 None] Terminate volume connection completed successfully. Jul 23 03:28:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-ab6f70fb-4c9f-4c86-a102-ed1f6db65117 req-7ac08cc1-28f9-4b27-819f-123a40c33af7 tempest-TestStampPattern-886894386 None] Deleting attachment 637ff2f4-15c6-4dbe-a17a-2abe953e39f3. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:28:26 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.a704132e-062d-48b4-a836-3eb01b9342bdewac8_0u.img" returned: 0 in 6.374s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:26 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[079e569e-81a7-4224-b4db-60ed5601e73e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:26 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 Jul 23 03:28:26 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:27 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4" returned: 0 in 0.819s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:27 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.a704132e-062d-48b4-a836-3eb01b9342bdewac8_0u.img {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:28:27 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] Converted 1024.00 MB image at 160.62 MB/s Jul 23 03:28:27 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] a704132e-062d-48b4-a836-3eb01b9342bd was raw, no need to convert to raw {{(pid=88392) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 23 03:28:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Acquiring lock "cinder-70c1a8ac-6f76-4279-93d2-b2461f1d4e05-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Lock "cinder-70c1a8ac-6f76-4279-93d2-b2461f1d4e05-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Acquiring lock "cinder-quobyte-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" acquired by "delete_volume" :: waited 0.030s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:29 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03500e7-2370-4b01-963b-a51c9e7f2b60]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:30 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 Jul 23 03:28:30 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:30 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" returned: 0 in 0.761s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:30 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05 Jul 23 03:28:30 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:31 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" returned: 0 in 0.580s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-70c1a8ac-6f76-4279-93d2-b2461f1d4e05" released by "delete_volume" :: held 1.445s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:31 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=70,cinder:UPDATE=53,cinder:DELETE=3,cinder:INSERT=15 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:28:31 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Created reservations ['f4157032-635f-4843-a697-da7b66930b1a', 'ebeabf4f-7de0-41d9-8c3f-c55b4f7598d4', 'da4b35ab-ec42-4e4c-aabb-64b616e526cb', '8dfa091c-f5cc-4d76-87de-c125de04c98b'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:31 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:28:31 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:32 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.744s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:32 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:32 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Deleted volume successfully. Jul 23 03:28:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-aa8e80a1-1185-4c68-86d0-b9ea90d84ec9 tempest-TestStampPattern-886894386 None] Lock "cinder-70c1a8ac-6f76-4279-93d2-b2461f1d4e05-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Acquiring lock "cinder-77b63e86-b4b7-463e-aac7-26f1df5ec774-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Lock "cinder-77b63e86-b4b7-463e-aac7-26f1df5ec774-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Acquiring lock "cinder-quobyte-5cae1010-068b-4c49-ba92-41614dcbcbcf" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-5cae1010-068b-4c49-ba92-41614dcbcbcf" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Acquiring lock "cinder-quobyte-77b63e86-b4b7-463e-aac7-26f1df5ec774" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-77b63e86-b4b7-463e-aac7-26f1df5ec774" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Deleting offline snapshot 77b63e86-b4b7-463e-aac7-26f1df5ec774 of volume 5cae1010-068b-4c49-ba92-41614dcbcbcf {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:28:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] snapshot_file for this snap is: volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:28:33 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f617f7c-56f3-4c7e-a7ec-e18e61f08cfa]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:33 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 Jul 23 03:28:33 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:34 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774" returned: 0 in 0.808s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cae1010-068b-4c49-ba92-41614dcbcbcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:28:34 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b11fa4-a3e6-4a56-a349-ea71622c6bea]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:34 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf Jul 23 03:28:34 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:35 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf" returned: 0 in 1.009s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:35 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 Jul 23 03:28:35 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:35 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774" returned: 0 in 0.537s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:35 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774 Jul 23 03:28:35 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:36 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf.77b63e86-b4b7-463e-aac7-26f1df5ec774" returned: 0 in 0.507s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-77b63e86-b4b7-463e-aac7-26f1df5ec774" released by "_delete_snapshot" :: held 3.143s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-5cae1010-068b-4c49-ba92-41614dcbcbcf" released by "delete_snapshot" :: held 3.200s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:36 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Created reservations ['460d96c7-18ef-4d37-8865-b0676d24f0e1', 'ec260e8a-07bc-4752-8c3a-121164504c7c', '7268758f-8a2f-4b77-8857-b6f08c54e50c', '1e8bd214-1dbc-4ba6-91d0-208ef5217543'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Delete snapshot completed successfully. Jul 23 03:28:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7e823c73-5f84-4513-8acc-937720d4bc5d tempest-TestStampPattern-886894386 None] Lock "cinder-77b63e86-b4b7-463e-aac7-26f1df5ec774-delete_snapshot" released by "delete_snapshot" :: held 3.636s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Acquiring lock "cinder-5cae1010-068b-4c49-ba92-41614dcbcbcf-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Lock "cinder-5cae1010-068b-4c49-ba92-41614dcbcbcf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Acquiring lock "cinder-quobyte-5cae1010-068b-4c49-ba92-41614dcbcbcf" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:28:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-5cae1010-068b-4c49-ba92-41614dcbcbcf" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:28:46 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5539c94-47a6-420e-9f18-4569461ddbc7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:28:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:46 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf Jul 23 03:28:46 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:46 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf" returned: 0 in 0.424s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:46 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf Jul 23 03:28:46 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:47 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5cae1010-068b-4c49-ba92-41614dcbcbcf" returned: 0 in 0.325s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Lock "cinder-quobyte-5cae1010-068b-4c49-ba92-41614dcbcbcf" released by "delete_volume" :: held 0.827s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Created reservations ['0fdc9e42-e0b7-4e7e-ac3d-36435e3537bb', '54497520-3dc0-4558-a1aa-07e927b31497', '83311147-a22e-427c-9452-fd40a6478af5', 'f28e56a1-53f0-4e4c-9ceb-7146da4b0f57'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:28:47 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:28:47 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:28:47 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.325s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:28:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Deleted volume successfully. Jul 23 03:28:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9ceb2c14-929a-4c58-822d-7128aa0c6a52 tempest-TestStampPattern-886894386 None] Lock "cinder-5cae1010-068b-4c49-ba92-41614dcbcbcf-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:28:57 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=12,cinder:INSERT=6,cinder:UPDATE=20 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:28:57 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:28:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-fb890c5c-91ff-4e50-a9bd-a7fbb1e2dfe1 req-9e6585cf-16a3-4eb2-91bd-eadccb5239d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 44.037s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] Uploaded volume to glance image-id: a704132e-062d-48b4-a836-3eb01b9342bd. {{(pid=88392) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 23 03:29:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-fb890c5c-91ff-4e50-a9bd-a7fbb1e2dfe1 req-9e6585cf-16a3-4eb2-91bd-eadccb5239d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.556s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-fb890c5c-91ff-4e50-a9bd-a7fbb1e2dfe1 req-9e6585cf-16a3-4eb2-91bd-eadccb5239d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:02 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-98e6c9c2-b342-4d66-b1f2-40d65913f071 tempest-VolumesActionsTest-2047332385 None] Copy volume to image completed successfully. Jul 23 03:29:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-fb890c5c-91ff-4e50-a9bd-a7fbb1e2dfe1 req-9e6585cf-16a3-4eb2-91bd-eadccb5239d8 tempest-TestInstancesWithCinderVolumes-540871461 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e6682fe-18f9-4f87-bea9-5f54a2f95b75', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:29:02 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-fb890c5c-91ff-4e50-a9bd-a7fbb1e2dfe1 req-9e6585cf-16a3-4eb2-91bd-eadccb5239d8 tempest-TestInstancesWithCinderVolumes-540871461 None] attachment_update completed successfully. Jul 23 03:29:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f85fb35-786e-4986-9080-9d0a601f8a3c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:05 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 Jul 23 03:29:05 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:05 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4" returned: 0 in 0.507s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c566776f-b3a0-47e6-8870-10ee4ebf78ee]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-98e19b52-544c-4ed2-9af2-7b83765a24d8 req-d25dadf1-1471-441a-a73e-ab5638907258 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:05 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 Jul 23 03:29:05 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:06 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4" returned: 0 in 0.392s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:06 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img Jul 23 03:29:06 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:29:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:07 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:29:07 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:08 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 1.244s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:08 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:08 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:29:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:29:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:29:11 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img" returned: 0 in 5.307s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:11 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbafec90-91fe-46b7-bd92-276b9ad54f99]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:11 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 Jul 23 03:29:11 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:11 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4" returned: 0 in 0.584s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:11 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:29:11 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Converted 1024.00 MB image at 192.90 MB/s Jul 23 03:29:11 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] 5496b603-9097-4b3e-ba90-49620b02f4c8 was raw, converting to qcow2 {{(pid=88392) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 23 03:29:11 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4ecc7c-932a-4f5e-b32e-fccf7d55aa01]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:12 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img Jul 23 03:29:12 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:12 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img" returned: 0 in 0.338s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:12 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img Jul 23 03:29:12 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Flow 'volume_create_manager' (03e937de-fcdc-47c9-9ca5-91cd59d5e35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396184f4-dacd-408f-8133-f69b5cbc2770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396184f4-dacd-408f-8133-f69b5cbc2770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16807523-6364-47fe-86b8-e7adead96274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6c0e10081342f8bfcfaa21fbb5249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:12Z,use_quota=True,user_id='f9a037cef14e407cbd795518c7a0294a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f94018-94b7-457f-8324-27170de10a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f94018-94b7-457f-8324-27170de10a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5a3a4a-3914-41f4-9660-6118df05f998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.image.glance [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Creating Keystone auth plugin from conf {{(pid=88392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:29:12 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img" returned: 1 in 0.357s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img /opt/stack/data/cinder/conversion/vol_upload_gt511ul5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:12 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img /opt/stack/data/cinder/conversion/vol_upload_gt511ul5 Jul 23 03:29:12 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5a3a4a-3914-41f4-9660-6118df05f998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16807523-6364-47fe-86b8-e7adead96274', 'volume_name': 'volume-16807523-6364-47fe-86b8-e7adead96274', 'volume_size': 1, 'image_id': '49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dffb4f7c7e2912b7517d44fd16d73939', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b6c0e10081342f8bfcfaa21fbb5249f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60e44223790fb64f9bd9bc124ffef8a34e6d0bca73fd24ed01729348f6ef9da85570d61c2de5f4be084e43ba24621a94bfb5b7c1ea93e0b3260db2aa6f6f9cb8', 'id': '49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'created_at': datetime.datetime(2026, 7, 23, 1, 29, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49589a8c-9eb2-409a-bfbb-51d90ab4e5c7/file', 'properties': {}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b40a5a-cf81-4a4c-9cbe-2522e3522221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b40a5a-cf81-4a4c-9cbe-2522e3522221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb1ad73-e75e-4b10-a3e0-a29c07a4d36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:12 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Volume 16807523-6364-47fe-86b8-e7adead96274: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16807523-6364-47fe-86b8-e7adead96274', 'volume_size': 1, 'image_id': '49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dffb4f7c7e2912b7517d44fd16d73939', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b6c0e10081342f8bfcfaa21fbb5249f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60e44223790fb64f9bd9bc124ffef8a34e6d0bca73fd24ed01729348f6ef9da85570d61c2de5f4be084e43ba24621a94bfb5b7c1ea93e0b3260db2aa6f6f9cb8', 'id': '49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'created_at': datetime.datetime(2026, 7, 23, 1, 29, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49589a8c-9eb2-409a-bfbb-51d90ab4e5c7/file', 'properties': {}}, 'image_service': } Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Trying to clone 16807523-6364-47fe-86b8-e7adead96274 from image 49589a8c-9eb2-409a-bfbb-51d90ab4e5c7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'metadata': {}}]). {{(pid=88392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:29:12 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img /opt/stack/data/cinder/conversion/vol_upload_gt511ul5" returned: 0 in 0.276s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Image conversion details: src /opt/stack/data/cinder/conversion/a0d90ec1-84a1-40bf-94ef-7950246613a4.temp_image.5496b603-9097-4b3e-ba90-49620b02f4c8xxozr851.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_gt511ul5 {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:29:12 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[67effa73-3c3d-45ef-a6fb-cd4d05914127]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gt511ul5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:12 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:29:12 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:29:13 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36b88bc-2032-41cb-bb5f-63187ca7d54c]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:13 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gt511ul5 Jul 23 03:29:13 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:13 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD Jul 23 03:29:13 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:13 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gt511ul5" returned: 0 in 0.333s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:13 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:13 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD Jul 23 03:29:13 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:13 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:13 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Temporary image 49589a8c-9eb2-409a-bfbb-51d90ab4e5c7 is fetched for user f9a037cef14e407cbd795518c7a0294a. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:29:13 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7e660a-0248-4aa8-8347-047f5d31db0f]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:13 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD Jul 23 03:29:13 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:14 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:14 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD Jul 23 03:29:14 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:14 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.566s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Uploaded volume to glance image-id: 5496b603-9097-4b3e-ba90-49620b02f4c8. {{(pid=88392) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-98e19b52-544c-4ed2-9af2-7b83765a24d8 req-d25dadf1-1471-441a-a73e-ab5638907258 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.983s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-98e19b52-544c-4ed2-9af2-7b83765a24d8 req-d25dadf1-1471-441a-a73e-ab5638907258 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.250s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16807523-6364-47fe-86b8-e7adead96274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6c0e10081342f8bfcfaa21fbb5249f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:12Z,use_quota=True,user_id='f9a037cef14e407cbd795518c7a0294a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Creating volume 16807523-6364-47fe-86b8-e7adead96274 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:14 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:14 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d20db7e8-9c6b-4ec3-bd75-3aeef7a1a07c tempest-VolumesActionsTest-2047332385 None] Copy volume to image completed successfully. Jul 23 03:29:14 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 1073741824 Jul 23 03:29:14 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-98e19b52-544c-4ed2-9af2-7b83765a24d8 req-d25dadf1-1471-441a-a73e-ab5638907258 tempest-TestInstancesWithCinderVolumes-540871461 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-1556a74d-7c45-4966-b322-77244a2988c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c63b7e7f-f5da-4d73-84dd-a684b33a8e51', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:29:14 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-98e19b52-544c-4ed2-9af2-7b83765a24d8 req-d25dadf1-1471-441a-a73e-ab5638907258 tempest-TestInstancesWithCinderVolumes-540871461 None] attachment_update completed successfully. Jul 23 03:29:15 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 1073741824" returned: 0 in 0.456s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:15 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 Jul 23 03:29:15 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:15 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274" returned: 0 in 0.315s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Attempting download of 49589a8c-9eb2-409a-bfbb-51d90ab4e5c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'metadata': {}}])) to volume 16807523-6364-47fe-86b8-e7adead96274. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Acquiring lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1cab08-0dec-4eb3-bc5d-76edafa16445]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_oaqbx_pq {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Acquiring lock "cinder-quobyte-a0d90ec1-84a1-40bf-94ef-7950246613a4" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Lock "cinder-quobyte-a0d90ec1-84a1-40bf-94ef-7950246613a4" acquired by "delete_volume" :: waited 0.034s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[98519bfe-8d71-4a9d-8afa-466208c53d6c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:15 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_oaqbx_pq Jul 23 03:29:15 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:15 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 Jul 23 03:29:15 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:16 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_oaqbx_pq" returned: 0 in 0.405s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_oaqbx_pq {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:16 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_oaqbx_pq Jul 23 03:29:16 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:16 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4" returned: 0 in 0.460s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:16 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4 Jul 23 03:29:16 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:16 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_oaqbx_pq" returned: 1 in 0.374s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_oaqbx_pq' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8001eaa2-1e4e-4592-8b2c-dc71a2333fc7]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:16 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD Jul 23 03:29:16 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:16 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a0d90ec1-84a1-40bf-94ef-7950246613a4" returned: 0 in 0.335s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Lock "cinder-quobyte-a0d90ec1-84a1-40bf-94ef-7950246613a4" released by "delete_volume" :: held 0.854s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Created reservations ['ce646e6b-4317-44ed-b23c-42620b2ae35f', '87e6027b-f49f-4b17-968e-74fa6ca3771d', '7ee047a8-b6c0-46c7-be91-fb888b5c5977', '66e17704-c220-40e8-b477-bf93cf4ea268'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:16 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:29:16 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:16 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:17 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD Jul 23 03:29:17 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:17 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.404s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:17 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:17 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Deleted volume successfully. Jul 23 03:29:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4ef72742-d85b-43b2-99f2-20747f92e4db tempest-VolumesActionsTest-2047332385 None] Lock "cinder-a0d90ec1-84a1-40bf-94ef-7950246613a4-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:17 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD" returned: 1 in 0.486s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:29:17 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] 49589a8c-9eb2-409a-bfbb-51d90ab4e5c7 was raw, converting to qcow2 {{(pid=88392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:29:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:17 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 Jul 23 03:29:17 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:18 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274" returned: 0 in 0.604s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49589a8c-9eb2-409a-bfbb-51d90ab4e5c7_xuclw1padevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:29:18 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:18 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 1G Jul 23 03:29:18 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:18 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 1G" returned: 0 in 0.349s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Downloaded image 49589a8c-9eb2-409a-bfbb-51d90ab4e5c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'metadata': {}}])) to volume 16807523-6364-47fe-86b8-e7adead96274 successfully. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Temporary image 49589a8c-9eb2-409a-bfbb-51d90ab4e5c7 for user f9a037cef14e407cbd795518c7a0294a is deleted. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Marking volume 16807523-6364-47fe-86b8-e7adead96274 as bootable. {{(pid=88392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Copying metadata from image 49589a8c-9eb2-409a-bfbb-51d90ab4e5c7 to 16807523-6364-47fe-86b8-e7adead96274. {{(pid=88392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Creating volume glance metadata for volume 16807523-6364-47fe-86b8-e7adead96274 backed by image 49589a8c-9eb2-409a-bfbb-51d90ab4e5c7 with: {'image_id': '49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dffb4f7c7e2912b7517d44fd16d73939', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb1ad73-e75e-4b10-a3e0-a29c07a4d36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16807523-6364-47fe-86b8-e7adead96274', 'volume_size': 1, 'image_id': '49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dffb4f7c7e2912b7517d44fd16d73939', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b6c0e10081342f8bfcfaa21fbb5249f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60e44223790fb64f9bd9bc124ffef8a34e6d0bca73fd24ed01729348f6ef9da85570d61c2de5f4be084e43ba24621a94bfb5b7c1ea93e0b3260db2aa6f6f9cb8', 'id': '49589a8c-9eb2-409a-bfbb-51d90ab4e5c7', 'created_at': datetime.datetime(2026, 7, 23, 1, 29, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 29, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49589a8c-9eb2-409a-bfbb-51d90ab4e5c7/file', 'properties': {}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70353ab-2919-46ab-b76f-4bef90ababf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:18 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Volume volume-16807523-6364-47fe-86b8-e7adead96274 (16807523-6364-47fe-86b8-e7adead96274): created successfully Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70353ab-2919-46ab-b76f-4bef90ababf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Flow 'volume_create_manager' (03e937de-fcdc-47c9-9ca5-91cd59d5e35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:18 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-337eefae-d63d-4aaf-addf-06c4f0e0f2e5 tempest-VolumeImageDependencyTests-1469780 None] Created volume successfully. Jul 23 03:29:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Acquiring lock "cinder-16807523-6364-47fe-86b8-e7adead96274-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Lock "cinder-16807523-6364-47fe-86b8-e7adead96274-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Acquiring lock "cinder-quobyte-16807523-6364-47fe-86b8-e7adead96274" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Lock "cinder-quobyte-16807523-6364-47fe-86b8-e7adead96274" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:19 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7bb97a-324d-4a23-9bda-8688b72e8cbd]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:19 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 Jul 23 03:29:19 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:19 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274" returned: 0 in 0.420s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:19 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274 Jul 23 03:29:19 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:19 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16807523-6364-47fe-86b8-e7adead96274" returned: 0 in 0.271s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Lock "cinder-quobyte-16807523-6364-47fe-86b8-e7adead96274" released by "delete_volume" :: held 0.735s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:20 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Created reservations ['bb4dc13b-e21b-48f2-a8da-4a46de724a26', 'd818a086-7086-417f-8cf0-347b915580e5', '619b300c-43ee-4c3f-b8d6-8312e20edb0b', '72f8e571-78fc-4b32-baf0-f99fcb02ee76'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:20 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:29:20 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:20 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.518s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:20 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:20 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Deleted volume successfully. Jul 23 03:29:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-046ad16a-d7ac-4e04-add0-78c9305dbe0e tempest-VolumeImageDependencyTests-1469780 None] Lock "cinder-16807523-6364-47fe-86b8-e7adead96274-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:20 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-47253135-97cb-42da-9bc7-17248ba574fe req-2e403654-7c3b-4be5-ac65-8db7f3c2fb78 tempest-TestInstancesWithCinderVolumes-540871461 None] Terminate volume connection completed successfully. Jul 23 03:29:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-47253135-97cb-42da-9bc7-17248ba574fe req-2e403654-7c3b-4be5-ac65-8db7f3c2fb78 tempest-TestInstancesWithCinderVolumes-540871461 None] Deleting attachment 6e6682fe-18f9-4f87-bea9-5f54a2f95b75. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:29:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "cinder-e0b6f05e-017c-46d1-89f9-b2d20d0938bd-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-e0b6f05e-017c-46d1-89f9-b2d20d0938bd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "cinder-quobyte-e0b6f05e-017c-46d1-89f9-b2d20d0938bd" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-quobyte-e0b6f05e-017c-46d1-89f9-b2d20d0938bd" acquired by "delete_volume" :: waited 0.034s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:21 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d22405-d225-48c0-86d6-b8a47a706a3b]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:21 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd Jul 23 03:29:21 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:22 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd" returned: 0 in 0.682s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:22 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:22 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Flow 'volume_create_manager' (edb62b5c-4150-4bac-b733-8b54312e023f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a3406a-06aa-44a7-b144-d3f4b402b827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a3406a-06aa-44a7-b144-d3f4b402b827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-106996447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb4d108-71fc-44d2-89fe-5360adc5c774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609fc015710840a69c06873d4ed08039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:22Z,use_quota=True,user_id='e27f623ec1314e2ca5a01cef3b1d122e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add84dd8-a435-4255-811e-110511b16501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add84dd8-a435-4255-811e-110511b16501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37687363-437a-4126-be9a-91fc27029de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37687363-437a-4126-be9a-91fc27029de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb4d108-71fc-44d2-89fe-5360adc5c774', 'volume_name': 'volume-fdb4d108-71fc-44d2-89fe-5360adc5c774', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1656d75-ee7d-4fb4-81d5-bd843e051a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1656d75-ee7d-4fb4-81d5-bd843e051a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051df5f1-725d-44ba-b277-880d054cad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:22 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Volume fdb4d108-71fc-44d2-89fe-5360adc5c774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb4d108-71fc-44d2-89fe-5360adc5c774', 'volume_size': 1} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-106996447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb4d108-71fc-44d2-89fe-5360adc5c774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609fc015710840a69c06873d4ed08039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:22Z,use_quota=True,user_id='e27f623ec1314e2ca5a01cef3b1d122e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Creating volume fdb4d108-71fc-44d2-89fe-5360adc5c774 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:22 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:22 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774 1073741824 Jul 23 03:29:22 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:22 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0b6f05e-017c-46d1-89f9-b2d20d0938bd" returned: 0 in 0.391s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-quobyte-e0b6f05e-017c-46d1-89f9-b2d20d0938bd" released by "delete_volume" :: held 1.159s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:22 devstack cinder-volume[88392]: WARNING cinder.quota [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1522640792-992902996 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1522640792-992902996, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:29:22 devstack cinder-volume[88392]: WARNING cinder.quota [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1522640792-992902996 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1522640792-992902996, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Created reservations ['f36f1fe3-26ea-4082-bed2-2726953df4ad', 'daf9a272-0e4e-4e2b-9837-0f63a195b389', 'a734f86f-3661-4155-96c5-53407f629136', '223a0af2-fddb-4dae-9712-c7187b548384'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:22 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:29:22 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:23 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774 1073741824" returned: 0 in 0.634s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:23 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.343s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Deleted volume successfully. Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3f83ae3e-84ac-41aa-9eeb-919900156bd9 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-e0b6f05e-017c-46d1-89f9-b2d20d0938bd-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:23 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774 Jul 23 03:29:23 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:23 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774" returned: 0 in 0.334s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051df5f1-725d-44ba-b277-880d054cad8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb4d108-71fc-44d2-89fe-5360adc5c774', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5df34c-fbd2-4e10-aac1-35c69c1370df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:23 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Volume volume-fdb4d108-71fc-44d2-89fe-5360adc5c774 (fdb4d108-71fc-44d2-89fe-5360adc5c774): created successfully Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5df34c-fbd2-4e10-aac1-35c69c1370df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Flow 'volume_create_manager' (edb62b5c-4150-4bac-b733-8b54312e023f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-eeb37772-980b-4b33-afec-dd98f24ff7ed tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Created volume successfully. Jul 23 03:29:24 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Flow 'volume_create_manager' (cec1dc12-9aa3-4284-b7c6-b3e2ba1ee9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea68414-f95c-4fbe-a508-3d5dd8881a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea68414-f95c-4fbe-a508-3d5dd8881a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1042918089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d175eae9-cc60-4866-9f04-39cc44bd9a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56758db325d42e9ba462b936d5cb86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:25Z,use_quota=True,user_id='11f626d33f414998bb2032032834b9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7158cf3d-388e-4181-a858-1f58571e2a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7158cf3d-388e-4181-a858-1f58571e2a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6885b05b-461c-41f9-8646-291784453b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6885b05b-461c-41f9-8646-291784453b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd175eae9-cc60-4866-9f04-39cc44bd9a96', 'volume_name': 'volume-d175eae9-cc60-4866-9f04-39cc44bd9a96', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df87cb8f-1bd6-4347-931c-85560e44a55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df87cb8f-1bd6-4347-931c-85560e44a55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec624f9-c874-420b-a822-bbd933327636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:25 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Volume d175eae9-cc60-4866-9f04-39cc44bd9a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d175eae9-cc60-4866-9f04-39cc44bd9a96', 'volume_size': 1} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1042918089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d175eae9-cc60-4866-9f04-39cc44bd9a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56758db325d42e9ba462b936d5cb86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:25Z,use_quota=True,user_id='11f626d33f414998bb2032032834b9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Creating volume d175eae9-cc60-4866-9f04-39cc44bd9a96 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:29:25 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:25 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 1073741824 Jul 23 03:29:25 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-f9fa9726-52e2-4334-b416-d0118b94a785 req-6c92c61a-7b6f-4a46-b704-7ff13dc85bf9 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:25 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 1073741824" returned: 0 in 0.464s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:25 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 Jul 23 03:29:25 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:25 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96" returned: 0 in 0.253s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-f9fa9726-52e2-4334-b416-d0118b94a785 req-6c92c61a-7b6f-4a46-b704-7ff13dc85bf9 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.654s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-f9fa9726-52e2-4334-b416-d0118b94a785 req-6c92c61a-7b6f-4a46-b704-7ff13dc85bf9 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec624f9-c874-420b-a822-bbd933327636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d175eae9-cc60-4866-9f04-39cc44bd9a96', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f64acea-30ac-4cce-b51f-6f90fa17449e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:25 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Volume volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 (d175eae9-cc60-4866-9f04-39cc44bd9a96): created successfully Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f64acea-30ac-4cce-b51f-6f90fa17449e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Flow 'volume_create_manager' (cec1dc12-9aa3-4284-b7c6-b3e2ba1ee9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f5276704-a98c-456c-9e4c-ed753402613b tempest-VolumesCloneTest-517415285 None] Created volume successfully. Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-f9fa9726-52e2-4334-b416-d0118b94a785 req-6c92c61a-7b6f-4a46-b704-7ff13dc85bf9 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-fdb4d108-71fc-44d2-89fe-5360adc5c774', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fa4e1da-7faa-44e0-8985-c2403ef54697', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:29:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-9c1e874a-cafe-4d41-9682-7099d2de3dd5 req-95bd2221-c218-428b-bb81-bc134fa63524 tempest-TestInstancesWithCinderVolumes-540871461 None] Terminate volume connection completed successfully. Jul 23 03:29:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-9c1e874a-cafe-4d41-9682-7099d2de3dd5 req-95bd2221-c218-428b-bb81-bc134fa63524 tempest-TestInstancesWithCinderVolumes-540871461 None] Deleting attachment c63b7e7f-f5da-4d73-84dd-a684b33a8e51. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:29:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-f9fa9726-52e2-4334-b416-d0118b94a785 req-6c92c61a-7b6f-4a46-b704-7ff13dc85bf9 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] attachment_update completed successfully. Jul 23 03:29:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "cinder-1556a74d-7c45-4966-b322-77244a2988c5-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-1556a74d-7c45-4966-b322-77244a2988c5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "cinder-quobyte-1556a74d-7c45-4966-b322-77244a2988c5" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-quobyte-1556a74d-7c45-4966-b322-77244a2988c5" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:26 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84450d4-33f7-475b-97b5-34aaa4475e5a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:26 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5 Jul 23 03:29:26 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5" returned: 0 in 0.398s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5 Jul 23 03:29:27 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1556a74d-7c45-4966-b322-77244a2988c5" returned: 0 in 0.342s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-quobyte-1556a74d-7c45-4966-b322-77244a2988c5" released by "delete_volume" :: held 0.807s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:27 devstack cinder-volume[88392]: WARNING cinder.quota [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-383704548-1466261716 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-383704548-1466261716, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:29:27 devstack cinder-volume[88392]: WARNING cinder.quota [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-383704548-1466261716 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-383704548-1466261716, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Created reservations ['1f97a24e-5cf8-4f98-8ae7-b08a01b74f3d', '2340f949-b1de-4a32-be66-3f7d4a9cd5a2', 'f8a3b89e-2437-4d88-8cb1-22be15fafd2b', 'd20355d3-94c9-4b8a-aa6a-3df4a8c8d40c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:29:27 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Flow 'volume_create_manager' (96f2b1ff-8afd-4dcb-965e-584c887878f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3646e847-5079-4ca7-9a0f-fb826b696609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3646e847-5079-4ca7-9a0f-fb826b696609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2021729655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61578f92-dd74-4987-8e74-3cb72daa123b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56758db325d42e9ba462b936d5cb86b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:29:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d175eae9-cc60-4866-9f04-39cc44bd9a96,status='creating',terminated_at=None,updated_at=2026-07-23T01:29:28Z,use_quota=True,user_id='11f626d33f414998bb2032032834b9ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee678f3-e56f-4b2a-954a-487b0e91f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee678f3-e56f-4b2a-954a-487b0e91f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a76f13-058c-4834-9143-d6fd80ad9422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a76f13-058c-4834-9143-d6fd80ad9422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '61578f92-dd74-4987-8e74-3cb72daa123b', 'volume_name': 'volume-61578f92-dd74-4987-8e74-3cb72daa123b', 'volume_size': 2, 'source_volid': 'd175eae9-cc60-4866-9f04-39cc44bd9a96', 'source_volstatus': 'available'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0567bfcd-b0be-4508-9bec-162953b1b42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0567bfcd-b0be-4508-9bec-162953b1b42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4477a7a-3f5c-4215-a6f8-b1283427d7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:27 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Volume 61578f92-dd74-4987-8e74-3cb72daa123b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-61578f92-dd74-4987-8e74-3cb72daa123b', 'volume_size': 2, 'source_volid': 'd175eae9-cc60-4866-9f04-39cc44bd9a96', 'source_volstatus': 'available'} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:27 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Cloning volume d175eae9-cc60-4866-9f04-39cc44bd9a96 to volume 61578f92-dd74-4987-8e74-3cb72daa123b Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Creating offline snapshot 29a75fe9-88ad-443d-8513-446e324b8e24 of volume d175eae9-cc60-4866-9f04-39cc44bd9a96 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c8deb5-1f46-4a2e-9a8a-4e13e3be376a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:27 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.306s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:27 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Deleted volume successfully. Jul 23 03:29:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bf4f03f-9b8e-4f97-9880-8edf0f3c5375 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-1556a74d-7c45-4966-b322-77244a2988c5-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:27 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 Jul 23 03:29:27 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:28 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96" returned: 0 in 0.528s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:28 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 1G Jul 23 03:29:28 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:28 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 1G" returned: 0 in 0.575s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:28 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 Jul 23 03:29:28 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:29 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-785c54b0-cfa2-44c1-bc25-80d4798ceec5 req-2b0f21d1-45be-4334-b75b-5f0d42876b62 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Terminate volume connection completed successfully. Jul 23 03:29:29 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-785c54b0-cfa2-44c1-bc25-80d4798ceec5 req-2b0f21d1-45be-4334-b75b-5f0d42876b62 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Deleting attachment 1fa4e1da-7faa-44e0-8985-c2403ef54697. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:29:29 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24" returned: 0 in 0.411s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:29 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 is being set with open permissions: ugo+rw Jul 23 03:29:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:29 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 Jul 23 03:29:29 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:29 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24" returned: 0 in 0.406s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:29 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.info Jul 23 03:29:29 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:30 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Acquiring lock "cinder-fdb4d108-71fc-44d2-89fe-5360adc5c774-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.info" returned: 0 in 0.377s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:30 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.info is being set with open permissions: ugo+rw Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "cinder-fdb4d108-71fc-44d2-89fe-5360adc5c774-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:30 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.info Jul 23 03:29:30 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Acquiring lock "cinder-quobyte-fdb4d108-71fc-44d2-89fe-5360adc5c774" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "cinder-quobyte-fdb4d108-71fc-44d2-89fe-5360adc5c774" acquired by "delete_volume" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fe4669-5e18-4a5e-9ab3-4d61d020b55b]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:30 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774 Jul 23 03:29:30 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:30 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.info" returned: 0 in 0.355s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Acquiring lock "cinder-quobyte-61578f92-dd74-4987-8e74-3cb72daa123b" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Lock "cinder-quobyte-61578f92-dd74-4987-8e74-3cb72daa123b" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] snapshot: 29a75fe9-88ad-443d-8513-446e324b8e24, volume: 61578f92-dd74-4987-8e74-3cb72daa123b, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb65b3c0-8687-4ba2-8174-41258554ac35]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:30 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 Jul 23 03:29:30 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:30 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774" returned: 0 in 0.487s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:30 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774 Jul 23 03:29:30 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:31 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-82cf1522-62ab-4147-b905-9258856ae4ce req-8b1af2db-9697-4b49-b2d2-03356202d0da tempest-TestInstancesWithCinderVolumes-540871461 None] Terminate volume connection completed successfully. Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-82cf1522-62ab-4147-b905-9258856ae4ce req-8b1af2db-9697-4b49-b2d2-03356202d0da tempest-TestInstancesWithCinderVolumes-540871461 None] Deleting attachment 1c8f90c2-a738-4577-8a81-cd5b365a2ea7. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:29:31 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdb4d108-71fc-44d2-89fe-5360adc5c774" returned: 0 in 0.311s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:31 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24" returned: 0 in 0.521s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d175eae9-cc60-4866-9f04-39cc44bd9a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "cinder-quobyte-fdb4d108-71fc-44d2-89fe-5360adc5c774" released by "delete_volume" :: held 0.870s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aa4f21-ab82-4607-a1f0-fb4127e7a2e9]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Created reservations ['dfd35238-6018-42f9-a1a7-a0ea83dfd51a', 'd57718dd-9620-44ba-b7ac-d0a813496aa2', '234f3e00-e04e-44ed-938a-eba6b138d521', '19025314-371d-48ec-8c06-725acb80deab'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:31 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 Jul 23 03:29:31 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:31 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:29:31 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:31 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:31 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Deleted volume successfully. Jul 23 03:29:31 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f1a6cb84-e910-4008-bdf0-057cee32d647 tempest-TestServerVolumeAttachScenarioOldVersion-614541369 None] Lock "cinder-fdb4d108-71fc-44d2-89fe-5360adc5c774-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96" returned: 0 in 0.439s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:29:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:31 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b Jul 23 03:29:31 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "cinder-b78df38d-8042-4e13-ba44-28010766afb2-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-b78df38d-8042-4e13-ba44-28010766afb2-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "cinder-quobyte-b78df38d-8042-4e13-ba44-28010766afb2" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-quobyte-b78df38d-8042-4e13-ba44-28010766afb2" acquired by "delete_volume" :: waited 0.061s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:32 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f157a78e-3b4e-48b5-abda-741d74503812]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:32 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 Jul 23 03:29:32 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:33 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2" returned: 0 in 0.732s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:33 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2 Jul 23 03:29:33 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:34 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b78df38d-8042-4e13-ba44-28010766afb2" returned: 0 in 0.810s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-quobyte-b78df38d-8042-4e13-ba44-28010766afb2" released by "delete_volume" :: held 1.660s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:34 devstack cinder-volume[88392]: WARNING cinder.quota [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1322725405-155674411 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1322725405-155674411, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:29:34 devstack cinder-volume[88392]: WARNING cinder.quota [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1322725405-155674411 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1322725405-155674411, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:29:34 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Created reservations ['941dcb9c-d6ee-4eac-b1b5-f8229f8e4812', '881325dd-7cff-4d8d-9f49-27b5868ff4a9', '207978d7-877e-4a57-abf4-8ad76aeda300', 'ef13eac1-91fd-4f49-9de7-67bba8b8c496'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:34 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:29:34 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:35 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 1.012s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:35 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:35 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Deleted volume successfully. Jul 23 03:29:35 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0ccd0d94-0813-4d0f-93e0-63072ff53768 tempest-TestInstancesWithCinderVolumes-540871461 None] Lock "cinder-b78df38d-8042-4e13-ba44-28010766afb2-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:37 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b" returned: 0 in 5.780s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:37 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc8fedd-afaa-4def-a09f-0471871f9cd8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:37 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 Jul 23 03:29:37 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:38 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96" returned: 0 in 0.689s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:29:38 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Converted 1024.00 MB image at 177.12 MB/s Jul 23 03:29:38 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b is being set with open permissions: ugo+rw Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:38 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b Jul 23 03:29:38 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:38 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b" returned: 0 in 0.293s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Lock "cinder-quobyte-61578f92-dd74-4987-8e74-3cb72daa123b" released by "_copy_volume_from_snapshot" :: held 7.847s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Acquiring lock "cinder-quobyte-29a75fe9-88ad-443d-8513-446e324b8e24" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Lock "cinder-quobyte-29a75fe9-88ad-443d-8513-446e324b8e24" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Deleting offline snapshot 29a75fe9-88ad-443d-8513-446e324b8e24 of volume d175eae9-cc60-4866-9f04-39cc44bd9a96 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] snapshot_file for this snap is: volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[73968572-cb57-49d6-95b1-6545d70fcdfd]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:38 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 Jul 23 03:29:38 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:38 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24" returned: 0 in 0.431s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d175eae9-cc60-4866-9f04-39cc44bd9a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:29:39 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c8310c-5ac0-4f52-a9a3-38db89688091]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:39 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 Jul 23 03:29:39 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:39 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96" returned: 0 in 0.382s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:39 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 Jul 23 03:29:39 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:39 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24" returned: 0 in 0.412s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:39 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24 Jul 23 03:29:39 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:40 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96.29a75fe9-88ad-443d-8513-446e324b8e24" returned: 0 in 0.305s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Lock "cinder-quobyte-29a75fe9-88ad-443d-8513-446e324b8e24" released by "_delete_snapshot" :: held 1.670s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.467s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4477a7a-3f5c-4215-a6f8-b1283427d7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61578f92-dd74-4987-8e74-3cb72daa123b', 'volume_size': 2, 'source_volid': 'd175eae9-cc60-4866-9f04-39cc44bd9a96', 'source_volstatus': 'available'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c97cd3c-e606-470d-a1d0-04daf505330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:29:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Volume volume-61578f92-dd74-4987-8e74-3cb72daa123b (61578f92-dd74-4987-8e74-3cb72daa123b): created successfully Jul 23 03:29:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c97cd3c-e606-470d-a1d0-04daf505330b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:29:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Flow 'volume_create_manager' (96f2b1ff-8afd-4dcb-965e-584c887878f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:29:40 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-05c7501a-0fa2-404f-ae09-00ff35e71201 tempest-VolumesCloneTest-517415285 None] Created volume successfully. Jul 23 03:29:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Acquiring lock "cinder-61578f92-dd74-4987-8e74-3cb72daa123b-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Lock "cinder-61578f92-dd74-4987-8e74-3cb72daa123b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Acquiring lock "cinder-quobyte-61578f92-dd74-4987-8e74-3cb72daa123b" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Lock "cinder-quobyte-61578f92-dd74-4987-8e74-3cb72daa123b" acquired by "delete_volume" :: waited 0.040s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:41 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a30667-2e2d-4c49-aff4-3d781ce6f0be]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:41 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b Jul 23 03:29:41 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:41 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b" returned: 0 in 0.463s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:41 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b Jul 23 03:29:41 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:42 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-61578f92-dd74-4987-8e74-3cb72daa123b" returned: 0 in 0.309s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Lock "cinder-quobyte-61578f92-dd74-4987-8e74-3cb72daa123b" released by "delete_volume" :: held 0.857s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Created reservations ['411a3c7c-ce85-46d6-b5f7-9214e844348d', 'b3ac2814-b802-4108-9c9a-d2a8818e380f', 'd89be9e4-c7c7-4df7-9f26-32629005607c', 'e7b9e664-5463-494d-af47-c3518f846564'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:42 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:29:42 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Acquiring lock "cinder-d175eae9-cc60-4866-9f04-39cc44bd9a96-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Lock "cinder-d175eae9-cc60-4866-9f04-39cc44bd9a96-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Acquiring lock "cinder-quobyte-d175eae9-cc60-4866-9f04-39cc44bd9a96" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Lock "cinder-quobyte-d175eae9-cc60-4866-9f04-39cc44bd9a96" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b808cb5c-a57c-4950-9f34-675996b294ae]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:42 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.547s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Deleted volume successfully. Jul 23 03:29:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4e4c5652-542c-407a-b783-e2a738c147fc tempest-VolumesCloneTest-517415285 None] Lock "cinder-61578f92-dd74-4987-8e74-3cb72daa123b-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:42 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 Jul 23 03:29:42 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:43 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96" returned: 0 in 0.650s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:43 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96 Jul 23 03:29:43 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:43 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d175eae9-cc60-4866-9f04-39cc44bd9a96" returned: 0 in 0.378s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Lock "cinder-quobyte-d175eae9-cc60-4866-9f04-39cc44bd9a96" released by "delete_volume" :: held 1.141s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:43 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Created reservations ['51b316e3-1d63-4698-bd98-40a514f161e6', '91e43d21-df19-484d-93b7-9914b54a0ebd', '5faa228f-df70-4e3e-97c1-88a51c7d3eb1', 'ebb8554a-def7-47c2-a371-2b79235fc857'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:29:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:29:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:29:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:29:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:29:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:29:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:29:43 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:29:43 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:29:44 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jul 23 03:29:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.333s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:29:44 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:29:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Deleted volume successfully. Jul 23 03:29:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9cd92c8c-3a84-4835-ab9f-3e0456285472 tempest-VolumesCloneTest-517415285 None] Lock "cinder-d175eae9-cc60-4866-9f04-39cc44bd9a96-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:29:53 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=86,cinder:UPDATE=82,cinder:INSERT=17,cinder:DELETE=5 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:29:54 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=79,cinder:UPDATE=87,cinder:INSERT=30,cinder:DELETE=7 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:30:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:30:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:06 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:30:06 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:07 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.288s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:30:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:30:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:30:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Flow 'volume_create_manager' (69022111-a7bb-4b79-bfbe-ff3e6998f34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e06964-1216-4d6f-a772-3316f8ae89f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e06964-1216-4d6f-a772-3316f8ae89f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-363404919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e616c5-9e72-43ab-b5c5-eb331ff72809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202bdfc5dd0749a3abf22c5d8d6f3c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:25Z,use_quota=True,user_id='ad0634972bdc42f389106b8369ef7171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cc7774-5557-4c68-aaef-2e026c81109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cc7774-5557-4c68-aaef-2e026c81109d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d229d7c5-3901-45d8-ae64-5201600f4165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d229d7c5-3901-45d8-ae64-5201600f4165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e616c5-9e72-43ab-b5c5-eb331ff72809', 'volume_name': 'volume-22e616c5-9e72-43ab-b5c5-eb331ff72809', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3751120c-048d-4fc4-9e1c-81e3927e0940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3751120c-048d-4fc4-9e1c-81e3927e0940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed478976-f3af-48b3-b263-c02c41c7c270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:25 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Volume 22e616c5-9e72-43ab-b5c5-eb331ff72809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e616c5-9e72-43ab-b5c5-eb331ff72809', 'volume_size': 1} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-363404919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e616c5-9e72-43ab-b5c5-eb331ff72809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202bdfc5dd0749a3abf22c5d8d6f3c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:25Z,use_quota=True,user_id='ad0634972bdc42f389106b8369ef7171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Creating volume 22e616c5-9e72-43ab-b5c5-eb331ff72809 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:25 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:25 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809 1073741824 Jul 23 03:30:25 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Flow 'volume_create_manager' (dfc36157-a0ea-4a58-980f-d1205c1225be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43211e40-ebec-44e8-b21c-6102c25022bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43211e40-ebec-44e8-b21c-6102c25022bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-254369396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36a26dc-a000-42da-857f-e1b1c5972284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202bdfc5dd0749a3abf22c5d8d6f3c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:26Z,use_quota=True,user_id='ad0634972bdc42f389106b8369ef7171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d33787b-c9f2-408e-97bc-c9ab38dd352f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d33787b-c9f2-408e-97bc-c9ab38dd352f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57df5c92-2a93-4b9f-bb61-78ee438cbd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57df5c92-2a93-4b9f-bb61-78ee438cbd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36a26dc-a000-42da-857f-e1b1c5972284', 'volume_name': 'volume-f36a26dc-a000-42da-857f-e1b1c5972284', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2cd0e5-069e-4520-bb19-a1690018154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2cd0e5-069e-4520-bb19-a1690018154b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1c0159-9ff0-439d-a746-a44b371281b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:25 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Volume f36a26dc-a000-42da-857f-e1b1c5972284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36a26dc-a000-42da-857f-e1b1c5972284', 'volume_size': 1} Jul 23 03:30:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:26 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809 1073741824" returned: 0 in 0.727s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:26 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809 Jul 23 03:30:26 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:26 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809" returned: 0 in 0.365s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-254369396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36a26dc-a000-42da-857f-e1b1c5972284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202bdfc5dd0749a3abf22c5d8d6f3c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:26Z,use_quota=True,user_id='ad0634972bdc42f389106b8369ef7171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Creating volume f36a26dc-a000-42da-857f-e1b1c5972284 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:26 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:26 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284 1073741824 Jul 23 03:30:26 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed478976-f3af-48b3-b263-c02c41c7c270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e616c5-9e72-43ab-b5c5-eb331ff72809', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b901654f-9146-4d08-8d4f-b357b0fa53a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:26 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Volume volume-22e616c5-9e72-43ab-b5c5-eb331ff72809 (22e616c5-9e72-43ab-b5c5-eb331ff72809): created successfully Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b901654f-9146-4d08-8d4f-b357b0fa53a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Flow 'volume_create_manager' (69022111-a7bb-4b79-bfbe-ff3e6998f34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:26 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-11cb7b08-4e5b-4b25-8217-543219dcc5d2 tempest-TestServerVolumeAttachmentScenario-257595982 None] Created volume successfully. Jul 23 03:30:27 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284 1073741824" returned: 0 in 0.742s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:27 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284 Jul 23 03:30:27 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:27 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284" returned: 0 in 0.434s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1c0159-9ff0-439d-a746-a44b371281b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36a26dc-a000-42da-857f-e1b1c5972284', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b0b047-d6a9-4548-be9c-1a7f402546fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:27 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Volume volume-f36a26dc-a000-42da-857f-e1b1c5972284 (f36a26dc-a000-42da-857f-e1b1c5972284): created successfully Jul 23 03:30:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b0b047-d6a9-4548-be9c-1a7f402546fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Flow 'volume_create_manager' (dfc36157-a0ea-4a58-980f-d1205c1225be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:27 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8316ceb2-c9c4-4396-b921-4ec57020d2f1 tempest-TestServerVolumeAttachmentScenario-257595982 None] Created volume successfully. Jul 23 03:30:31 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Flow 'volume_create_manager' (4cedf68e-740c-458e-b456-02a42d6b078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dea81f-8883-475a-8372-8cdc2adac0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dea81f-8883-475a-8372-8cdc2adac0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1283685965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c5f763-9908-4a4c-8044-9abd778fd28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c184f5500248f89a6c12740c43be7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:32Z,use_quota=True,user_id='280ca1b671a34cc2b67254a023361d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c455bbf-4d1b-46ed-860a-01433688f3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c455bbf-4d1b-46ed-860a-01433688f3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6418cb8c-c17a-4759-9aec-d391e33574d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:31 devstack cinder-volume[88392]: DEBUG cinder.image.glance [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Creating Keystone auth plugin from conf {{(pid=88392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:30:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6418cb8c-c17a-4759-9aec-d391e33574d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5c5f763-9908-4a4c-8044-9abd778fd28b', 'volume_name': 'volume-c5c5f763-9908-4a4c-8044-9abd778fd28b', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f596ab-b4a9-4ed0-b57f-03085e82be97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f596ab-b4a9-4ed0-b57f-03085e82be97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16aff36-8ee4-4f79-b53e-14f3d5f50a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:32 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Volume c5c5f763-9908-4a4c-8044-9abd778fd28b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5c5f763-9908-4a4c-8044-9abd778fd28b', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 03:30:32 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Trying to clone c5c5f763-9908-4a4c-8044-9abd778fd28b from image 2d810839-198a-4642-93d6-ed27296a0802 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]). {{(pid=88392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:30:32 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:30:32 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Image download 20.69 MB at 20.69 MB/s Jul 23 03:30:33 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a96695-3036-4987-8935-0b2a4ce099e0]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:33 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD Jul 23 03:30:33 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:33 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD" returned: 0 in 0.554s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:33 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Temporary image 2d810839-198a-4642-93d6-ed27296a0802 is fetched for user 280ca1b671a34cc2b67254a023361d6b. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:30:33 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[51149fc8-ef01-4ee9-8131-4cb95c100637]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:33 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD Jul 23 03:30:33 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:34 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1283685965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c5f763-9908-4a4c-8044-9abd778fd28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1c184f5500248f89a6c12740c43be7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:32Z,use_quota=True,user_id='280ca1b671a34cc2b67254a023361d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Creating volume c5c5f763-9908-4a4c-8044-9abd778fd28b {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:34 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:34 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b 1073741824 Jul 23 03:30:34 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:34 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b 1073741824" returned: 0 in 0.745s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:35 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b Jul 23 03:30:35 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:35 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b" returned: 0 in 0.305s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:35 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:35 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Attempting download of 2d810839-198a-4642-93d6-ed27296a0802 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}])) to volume c5c5f763-9908-4a4c-8044-9abd778fd28b. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:30:35 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc2b1f-9b7c-487b-a210-269eb9d199a8]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_lds847ed {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:35 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_lds847ed Jul 23 03:30:35 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:35 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_lds847ed" returned: 0 in 0.463s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_lds847ed {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:36 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_lds847ed Jul 23 03:30:36 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:36 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_lds847ed" returned: 1 in 0.479s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d810839-198a-4642-93d6-ed27296a0802_lds847ed' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:30:36 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9611270f-1f23-4725-8389-6d781ab7d1d8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:30:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:36 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD Jul 23 03:30:36 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:36 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD" returned: 0 in 0.548s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:36 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] 2d810839-198a-4642-93d6-ed27296a0802 was qcow2, converting to qcow2 {{(pid=88392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:30:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:37 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b Jul 23 03:30:37 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Flow 'volume_create_manager' (8b3a8bfc-0458-4888-a259-7cf1d421b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aad5e7a-d79b-4cec-a3e2-6a8efe42e17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aad5e7a-d79b-4cec-a3e2-6a8efe42e17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-273165354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0af710-be19-4c01-af1d-9600b8950a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104fd85541334c18b07f355623617b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:37Z,use_quota=True,user_id='22efdf2182834b94b49677bf38618a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75316459-ca0c-41fb-bd9e-12894712f9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75316459-ca0c-41fb-bd9e-12894712f9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf3a5c8-cc8d-4d6d-b759-5828a949f01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf3a5c8-cc8d-4d6d-b759-5828a949f01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c0af710-be19-4c01-af1d-9600b8950a99', 'volume_name': 'volume-0c0af710-be19-4c01-af1d-9600b8950a99', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e53fdd0-9e27-47eb-a310-cf27ba9a551b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e53fdd0-9e27-47eb-a310-cf27ba9a551b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ba66e7-6109-4812-8aad-74034c7e6c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:37 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Volume 0c0af710-be19-4c01-af1d-9600b8950a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c0af710-be19-4c01-af1d-9600b8950a99', 'volume_size': 1} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-273165354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0af710-be19-4c01-af1d-9600b8950a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104fd85541334c18b07f355623617b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:30:37Z,use_quota=True,user_id='22efdf2182834b94b49677bf38618a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Creating volume 0c0af710-be19-4c01-af1d-9600b8950a99 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:30:37 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:30:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:37 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99 1073741824 Jul 23 03:30:37 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:38 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99 1073741824" returned: 0 in 0.995s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:38 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99 Jul 23 03:30:38 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:39 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99" returned: 0 in 0.598s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:30:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ba66e7-6109-4812-8aad-74034c7e6c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0af710-be19-4c01-af1d-9600b8950a99', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae07b117-2bbf-46d7-b115-2e1bbd642792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Volume volume-0c0af710-be19-4c01-af1d-9600b8950a99 (0c0af710-be19-4c01-af1d-9600b8950a99): created successfully Jul 23 03:30:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae07b117-2bbf-46d7-b115-2e1bbd642792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Flow 'volume_create_manager' (8b3a8bfc-0458-4888-a259-7cf1d421b92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ab83a03b-4b67-41ac-a850-e8a865d00692 tempest-TestMinimumBasicScenario-1304232039 None] Created volume successfully. Jul 23 03:30:40 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b" returned: 0 in 3.090s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d810839-198a-4642-93d6-ed27296a0802_f7syyue8devstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:30:40 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Converted 112.00 MB image at 36.23 MB/s Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:30:40 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b 1G Jul 23 03:30:40 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:30:40 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b 1G" returned: 0 in 0.360s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Downloaded image 2d810839-198a-4642-93d6-ed27296a0802 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}])) to volume c5c5f763-9908-4a4c-8044-9abd778fd28b successfully. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Temporary image 2d810839-198a-4642-93d6-ed27296a0802 for user 280ca1b671a34cc2b67254a023361d6b is deleted. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Marking volume c5c5f763-9908-4a4c-8044-9abd778fd28b as bootable. {{(pid=88392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Copying metadata from image 2d810839-198a-4642-93d6-ed27296a0802 to c5c5f763-9908-4a4c-8044-9abd778fd28b. {{(pid=88392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Creating volume glance metadata for volume c5c5f763-9908-4a4c-8044-9abd778fd28b backed by image 2d810839-198a-4642-93d6-ed27296a0802 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16aff36-8ee4-4f79-b53e-14f3d5f50a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c5f763-9908-4a4c-8044-9abd778fd28b', 'volume_size': 1, 'image_id': '2d810839-198a-4642-93d6-ed27296a0802', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d810839-198a-4642-93d6-ed27296a0802', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db83976cde77427d88c8d52458b82234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d810839-198a-4642-93d6-ed27296a0802', 'created_at': datetime.datetime(2026, 7, 23, 1, 11, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 11, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d810839-198a-4642-93d6-ed27296a0802/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6181d6d7-744c-40b9-b8b2-7bc8be92a647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:30:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Volume volume-c5c5f763-9908-4a4c-8044-9abd778fd28b (c5c5f763-9908-4a4c-8044-9abd778fd28b): created successfully Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6181d6d7-744c-40b9-b8b2-7bc8be92a647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:30:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Flow 'volume_create_manager' (4cedf68e-740c-458e-b456-02a42d6b078c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:30:40 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a30756a2-38ee-4559-b050-cc96ce2ad9b7 tempest-TestShelveInstance-44177405 None] Created volume successfully. Jul 23 03:30:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-29c7b697-501e-4474-8d18-5886aec11f8d req-0d4c5fee-fe40-41b5-b333-08f8b0061a3d tempest-TestMinimumBasicScenario-1304232039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-29c7b697-501e-4474-8d18-5886aec11f8d req-0d4c5fee-fe40-41b5-b333-08f8b0061a3d tempest-TestMinimumBasicScenario-1304232039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-29c7b697-501e-4474-8d18-5886aec11f8d req-0d4c5fee-fe40-41b5-b333-08f8b0061a3d tempest-TestMinimumBasicScenario-1304232039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-29c7b697-501e-4474-8d18-5886aec11f8d req-0d4c5fee-fe40-41b5-b333-08f8b0061a3d tempest-TestMinimumBasicScenario-1304232039 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-0c0af710-be19-4c01-af1d-9600b8950a99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca7f7b33-0ada-41a0-b008-695a974cb056', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:30:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-29c7b697-501e-4474-8d18-5886aec11f8d req-0d4c5fee-fe40-41b5-b333-08f8b0061a3d tempest-TestMinimumBasicScenario-1304232039 None] attachment_update completed successfully. Jul 23 03:30:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-fc5a9304-2081-4ec6-b99c-8a8168a36c13 req-719a9bf8-a7de-4d75-b966-7c006f3da17f tempest-TestShelveInstance-44177405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:30:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-fc5a9304-2081-4ec6-b99c-8a8168a36c13 req-719a9bf8-a7de-4d75-b966-7c006f3da17f tempest-TestShelveInstance-44177405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:30:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-fc5a9304-2081-4ec6-b99c-8a8168a36c13 req-719a9bf8-a7de-4d75-b966-7c006f3da17f tempest-TestShelveInstance-44177405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:30:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-fc5a9304-2081-4ec6-b99c-8a8168a36c13 req-719a9bf8-a7de-4d75-b966-7c006f3da17f tempest-TestShelveInstance-44177405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-c5c5f763-9908-4a4c-8044-9abd778fd28b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4f4476b-6ccc-4336-996b-056ba41285b4', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:30:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-fc5a9304-2081-4ec6-b99c-8a8168a36c13 req-719a9bf8-a7de-4d75-b966-7c006f3da17f tempest-TestShelveInstance-44177405 None] attachment_update completed successfully. Jul 23 03:30:56 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=17,cinder:SELECT=33,cinder:DELETE=3,cinder:INSERT=8 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:30:56 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=25,cinder:UPDATE=17,cinder:INSERT=9,cinder:DELETE=1 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:31:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:31:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:06 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:31:06 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-94542b8c-58e1-420b-a6f8-8b7babbe9c58 req-20c1ff7b-46c4-43f5-b12c-3463b8c4f254 tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-94542b8c-58e1-420b-a6f8-8b7babbe9c58 req-20c1ff7b-46c4-43f5-b12c-3463b8c4f254 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-94542b8c-58e1-420b-a6f8-8b7babbe9c58 req-20c1ff7b-46c4-43f5-b12c-3463b8c4f254 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-94542b8c-58e1-420b-a6f8-8b7babbe9c58 req-20c1ff7b-46c4-43f5-b12c-3463b8c4f254 tempest-TestServerVolumeAttachmentScenario-257595982 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-22e616c5-9e72-43ab-b5c5-eb331ff72809', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b717a755-9fa7-4568-8726-e1010a125dd1', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:31:07 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-94542b8c-58e1-420b-a6f8-8b7babbe9c58 req-20c1ff7b-46c4-43f5-b12c-3463b8c4f254 tempest-TestServerVolumeAttachmentScenario-257595982 None] attachment_update completed successfully. Jul 23 03:31:07 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.408s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:31:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:31:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:31:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-31843726-0e5c-4218-aa67-c7ac3f98963a req-cffc591d-dba7-498b-b9dc-cb5531d3a49d tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-31843726-0e5c-4218-aa67-c7ac3f98963a req-cffc591d-dba7-498b-b9dc-cb5531d3a49d tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-31843726-0e5c-4218-aa67-c7ac3f98963a req-cffc591d-dba7-498b-b9dc-cb5531d3a49d tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-31843726-0e5c-4218-aa67-c7ac3f98963a req-cffc591d-dba7-498b-b9dc-cb5531d3a49d tempest-TestServerVolumeAttachmentScenario-257595982 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-f36a26dc-a000-42da-857f-e1b1c5972284', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72f4cbe1-0f01-4214-a416-5a06e9fa9ee1', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:31:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-31843726-0e5c-4218-aa67-c7ac3f98963a req-cffc591d-dba7-498b-b9dc-cb5531d3a49d tempest-TestServerVolumeAttachmentScenario-257595982 None] attachment_update completed successfully. Jul 23 03:31:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-0cfb8d16-5ef6-46da-9cfc-2595002e8b7f req-0b694796-ae65-41ff-a14b-200608209d09 tempest-TestServerVolumeAttachmentScenario-257595982 None] Terminate volume connection completed successfully. Jul 23 03:31:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-0cfb8d16-5ef6-46da-9cfc-2595002e8b7f req-0b694796-ae65-41ff-a14b-200608209d09 tempest-TestServerVolumeAttachmentScenario-257595982 None] Deleting attachment 72f4cbe1-0f01-4214-a416-5a06e9fa9ee1. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:31:14 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-a7e9d05c-1853-47ee-9ac4-29c92452670f req-df0857c8-e23e-41b9-84dc-37143b08fdb3 tempest-TestServerVolumeAttachmentScenario-257595982 None] Terminate volume connection completed successfully. Jul 23 03:31:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-a7e9d05c-1853-47ee-9ac4-29c92452670f req-df0857c8-e23e-41b9-84dc-37143b08fdb3 tempest-TestServerVolumeAttachmentScenario-257595982 None] Deleting attachment b717a755-9fa7-4568-8726-e1010a125dd1. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:31:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "cinder-f36a26dc-a000-42da-857f-e1b1c5972284-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "cinder-f36a26dc-a000-42da-857f-e1b1c5972284-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "cinder-quobyte-f36a26dc-a000-42da-857f-e1b1c5972284" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "cinder-quobyte-f36a26dc-a000-42da-857f-e1b1c5972284" acquired by "delete_volume" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:19 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[572c90c0-f14d-4595-a60e-52663debaaba]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:20 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284 Jul 23 03:31:20 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:20 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284" returned: 0 in 0.359s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:20 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284 Jul 23 03:31:20 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:20 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f36a26dc-a000-42da-857f-e1b1c5972284" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "cinder-quobyte-f36a26dc-a000-42da-857f-e1b1c5972284" released by "delete_volume" :: held 0.658s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Created reservations ['7080abf5-ac4f-4291-9b1e-490916aaa99b', '3d112acc-2bb2-48fb-90ab-3b118b4e20c7', '9aa1ebe8-c66f-4d49-8c12-909b3720376a', 'ae9f86da-173e-4f65-8c91-e4bc1013d46f'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:20 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:31:20 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:20 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.238s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:20 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Deleted volume successfully. Jul 23 03:31:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2092b22c-d1e3-41e5-8078-9f133fce7631 tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "cinder-f36a26dc-a000-42da-857f-e1b1c5972284-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "cinder-22e616c5-9e72-43ab-b5c5-eb331ff72809-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "cinder-22e616c5-9e72-43ab-b5c5-eb331ff72809-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "cinder-quobyte-22e616c5-9e72-43ab-b5c5-eb331ff72809" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "cinder-quobyte-22e616c5-9e72-43ab-b5c5-eb331ff72809" acquired by "delete_volume" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50a9d74-14a9-4802-bfcd-d78e8c3a59a7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:21 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809 Jul 23 03:31:21 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:21 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809" returned: 0 in 0.353s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:21 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809 Jul 23 03:31:21 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:21 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e616c5-9e72-43ab-b5c5-eb331ff72809" returned: 0 in 0.242s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "cinder-quobyte-22e616c5-9e72-43ab-b5c5-eb331ff72809" released by "delete_volume" :: held 0.631s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Created reservations ['a779bdc7-9763-4c33-90bc-9c1b51b99daf', '750f29fc-c344-4d56-876e-4dd4742563d1', '637a23c6-6693-4a8d-8735-692d6821b227', '48b45bb9-fd1e-4f3d-afb2-cb3a5537bdfb'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:21 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:31:21 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:22 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.241s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:22 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:22 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Deleted volume successfully. Jul 23 03:31:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3ac3a254-bf6b-4114-a883-d8207d2c4e1e tempest-TestServerVolumeAttachmentScenario-257595982 None] Lock "cinder-22e616c5-9e72-43ab-b5c5-eb331ff72809-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:31 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=26,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Flow 'volume_create_manager' (e373fcc3-ed2d-474d-a5ce-f81fb54c41ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5693c92-09ff-4a76-ad06-231085ff63ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5693c92-09ff-4a76-ad06-231085ff63ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87b806f-7107-429a-81e8-9daa7a43a563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591dca0069c6486ea550f04a8535d2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:32Z,use_quota=True,user_id='b903f8f5ba8a4ceab569b50f76a5da8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556b39b4-d6c4-4b27-9df6-02d46a82da89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556b39b4-d6c4-4b27-9df6-02d46a82da89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf48a2a-8484-4b34-97bd-071fcff7c6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf48a2a-8484-4b34-97bd-071fcff7c6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c87b806f-7107-429a-81e8-9daa7a43a563', 'volume_name': 'volume-c87b806f-7107-429a-81e8-9daa7a43a563', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa08cfa-8170-4445-a5e4-582eb349494e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa08cfa-8170-4445-a5e4-582eb349494e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc48d99-ccba-47d3-b788-e46856192167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:32 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Volume c87b806f-7107-429a-81e8-9daa7a43a563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c87b806f-7107-429a-81e8-9daa7a43a563', 'volume_size': 1} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87b806f-7107-429a-81e8-9daa7a43a563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591dca0069c6486ea550f04a8535d2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:32Z,use_quota=True,user_id='b903f8f5ba8a4ceab569b50f76a5da8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Creating volume c87b806f-7107-429a-81e8-9daa7a43a563 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:32 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:32 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563 1073741824 Jul 23 03:31:32 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:32 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563 1073741824" returned: 0 in 0.423s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:32 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563 Jul 23 03:31:32 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:32 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563" returned: 0 in 0.248s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc48d99-ccba-47d3-b788-e46856192167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c87b806f-7107-429a-81e8-9daa7a43a563', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031b5bd5-7416-4ffc-971f-12fb9ae3500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:32 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Volume volume-c87b806f-7107-429a-81e8-9daa7a43a563 (c87b806f-7107-429a-81e8-9daa7a43a563): created successfully Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031b5bd5-7416-4ffc-971f-12fb9ae3500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:32 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Flow 'volume_create_manager' (e373fcc3-ed2d-474d-a5ce-f81fb54c41ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:32 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-29ba3c29-5212-4776-b658-7c11bfd14354 tempest-CinderUnicodeTest-919951574 None] Created volume successfully. Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Flow 'volume_create_manager' (cd8cfcd7-ab38-4341-8ad2-3d7a3eb69c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09497a6b-1a82-482e-a4e9-c86e0ad75602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09497a6b-1a82-482e-a4e9-c86e0ad75602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1154718928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fd4536-1ab5-4618-9f01-64258bfc7c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591dca0069c6486ea550f04a8535d2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:34Z,use_quota=True,user_id='b903f8f5ba8a4ceab569b50f76a5da8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b9eb34-93e4-49a8-8e7d-6506a4ecf4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b9eb34-93e4-49a8-8e7d-6506a4ecf4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529b5706-31c0-42a6-8205-0e60f46f2155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529b5706-31c0-42a6-8205-0e60f46f2155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85fd4536-1ab5-4618-9f01-64258bfc7c3f', 'volume_name': 'volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35589353-8598-4896-b3cb-18403356729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35589353-8598-4896-b3cb-18403356729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e1577a-a4b1-40ad-af7c-ef2bf35a29e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:33 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Volume 85fd4536-1ab5-4618-9f01-64258bfc7c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f', 'volume_size': 1} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1154718928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fd4536-1ab5-4618-9f01-64258bfc7c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591dca0069c6486ea550f04a8535d2ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:34Z,use_quota=True,user_id='b903f8f5ba8a4ceab569b50f76a5da8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Creating volume 85fd4536-1ab5-4618-9f01-64258bfc7c3f {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:33 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:31:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:33 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f 1073741824 Jul 23 03:31:33 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:34 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f 1073741824" returned: 0 in 0.438s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:34 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f Jul 23 03:31:34 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:34 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f" returned: 0 in 0.287s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e1577a-a4b1-40ad-af7c-ef2bf35a29e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2090f1a-f61d-431b-b5ba-dc9ebcbce350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:34 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Volume volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f (85fd4536-1ab5-4618-9f01-64258bfc7c3f): created successfully Jul 23 03:31:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2090f1a-f61d-431b-b5ba-dc9ebcbce350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:34 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Flow 'volume_create_manager' (cd8cfcd7-ab38-4341-8ad2-3d7a3eb69c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:34 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-95ebcb68-0ee7-4387-ae4e-03430cf40d39 tempest-CinderUnicodeTest-919951574 None] Created volume successfully. Jul 23 03:31:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:35 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] Creating offline snapshot f0bbe819-04d2-46e3-aff3-d433de4bb33a of volume 85fd4536-1ab5-4618-9f01-64258bfc7c3f {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:31:36 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d12a03-b075-48d5-91c5-709b07f5056c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:36 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f Jul 23 03:31:36 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:36 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f" returned: 0 in 0.460s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:36 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a 1G Jul 23 03:31:36 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-c8059f0e-3fec-4e78-9176-38804af85fcb req-8ebdd8a3-1eab-46b4-ace3-004c81f217ff tempest-TestShelveInstance-44177405 None] Terminate volume connection completed successfully. Jul 23 03:31:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-c8059f0e-3fec-4e78-9176-38804af85fcb req-8ebdd8a3-1eab-46b4-ace3-004c81f217ff tempest-TestShelveInstance-44177405 None] Deleting attachment e4f4476b-6ccc-4336-996b-056ba41285b4. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:31:36 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a 1G" returned: 0 in 0.454s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:36 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a Jul 23 03:31:36 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:37 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a" returned: 0 in 0.339s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:37 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a is being set with open permissions: ugo+rw Jul 23 03:31:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:37 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a Jul 23 03:31:37 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:37 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a" returned: 0 in 0.262s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:37 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.info Jul 23 03:31:37 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:37 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.info" returned: 0 in 0.259s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:37 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.info is being set with open permissions: ugo+rw Jul 23 03:31:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:37 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.info Jul 23 03:31:37 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:38 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.info" returned: 0 in 0.267s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.139s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:38 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a5ad0378-67ce-4841-8296-1e24d6b9dfd8 tempest-CinderUnicodeTest-919951574 None] Create snapshot completed successfully Jul 23 03:31:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-8e992191-4221-462a-a665-de9131ea26a7 req-787f3c6f-4a4e-485e-9187-641217dbbd63 tempest-TestShelveInstance-44177405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-8e992191-4221-462a-a665-de9131ea26a7 req-787f3c6f-4a4e-485e-9187-641217dbbd63 tempest-TestShelveInstance-44177405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-8e992191-4221-462a-a665-de9131ea26a7 req-787f3c6f-4a4e-485e-9187-641217dbbd63 tempest-TestShelveInstance-44177405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-8e992191-4221-462a-a665-de9131ea26a7 req-787f3c6f-4a4e-485e-9187-641217dbbd63 tempest-TestShelveInstance-44177405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173', 'name': 'volume-c5c5f763-9908-4a4c-8044-9abd778fd28b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58634aa0-91a9-4081-9290-9841641f7380', 'enforce_multipath': True} {{(pid=88392) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 03:31:38 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-8e992191-4221-462a-a665-de9131ea26a7 req-787f3c6f-4a4e-485e-9187-641217dbbd63 tempest-TestShelveInstance-44177405 None] attachment_update completed successfully. Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Acquiring lock "cinder-f0bbe819-04d2-46e3-aff3-d433de4bb33a-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Lock "cinder-f0bbe819-04d2-46e3-aff3-d433de4bb33a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Acquiring lock "cinder-quobyte-85fd4536-1ab5-4618-9f01-64258bfc7c3f" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Lock "cinder-quobyte-85fd4536-1ab5-4618-9f01-64258bfc7c3f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Acquiring lock "cinder-quobyte-f0bbe819-04d2-46e3-aff3-d433de4bb33a" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Lock "cinder-quobyte-f0bbe819-04d2-46e3-aff3-d433de4bb33a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Deleting offline snapshot f0bbe819-04d2-46e3-aff3-d433de4bb33a of volume 85fd4536-1ab5-4618-9f01-64258bfc7c3f {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] snapshot_file for this snap is: volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82951d1-5428-41ea-836e-f44d371ac724]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:39 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a Jul 23 03:31:39 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:39 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a" returned: 0 in 0.394s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0077e7a3-8a77-43c3-96d5-e2dbcccdb4d7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:39 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f Jul 23 03:31:39 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:40 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f" returned: 0 in 0.472s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:40 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a Jul 23 03:31:40 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:40 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a" returned: 0 in 0.365s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:40 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a Jul 23 03:31:40 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:40 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f.f0bbe819-04d2-46e3-aff3-d433de4bb33a" returned: 0 in 0.252s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Lock "cinder-quobyte-f0bbe819-04d2-46e3-aff3-d433de4bb33a" released by "_delete_snapshot" :: held 1.622s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Lock "cinder-quobyte-85fd4536-1ab5-4618-9f01-64258bfc7c3f" released by "delete_snapshot" :: held 1.644s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:40 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Created reservations ['33ac71f4-41af-465e-aca5-a638ad17b660', '1ce9e0dd-5246-4abe-a1a5-684f8cad113b', '5ad23031-d9af-428b-bb21-b34978d9af4d', '556e321f-3e28-4804-bf64-6d1956737585'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:40 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Delete snapshot completed successfully. Jul 23 03:31:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-54ddf1da-ca87-4360-af50-fe1fe63c1494 tempest-CinderUnicodeTest-919951574 None] Lock "cinder-f0bbe819-04d2-46e3-aff3-d433de4bb33a-delete_snapshot" released by "delete_snapshot" :: held 1.820s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Acquiring lock "cinder-85fd4536-1ab5-4618-9f01-64258bfc7c3f-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Lock "cinder-85fd4536-1ab5-4618-9f01-64258bfc7c3f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Acquiring lock "cinder-quobyte-85fd4536-1ab5-4618-9f01-64258bfc7c3f" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Lock "cinder-quobyte-85fd4536-1ab5-4618-9f01-64258bfc7c3f" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:41 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bb5fa3-5319-494a-9be2-6d5212d8473d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:41 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f Jul 23 03:31:41 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:42 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f" returned: 0 in 0.549s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:42 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f Jul 23 03:31:42 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:42 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85fd4536-1ab5-4618-9f01-64258bfc7c3f" returned: 0 in 0.314s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Lock "cinder-quobyte-85fd4536-1ab5-4618-9f01-64258bfc7c3f" released by "delete_volume" :: held 0.982s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:42 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Created reservations ['7866e99f-c40f-4d5d-9380-f80a931cf498', 'e84701d1-ec4d-4d80-b2fc-fac365f32888', '554d22d2-06e1-48f5-9ef5-c143ca915263', 'c9c7f0f6-7db6-45aa-914c-0643ee191c15'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:42 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:31:42 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:43 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.334s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:43 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:43 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Deleted volume successfully. Jul 23 03:31:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-09a8d9cb-153a-436a-94f3-4966965a42ed tempest-CinderUnicodeTest-919951574 None] Lock "cinder-85fd4536-1ab5-4618-9f01-64258bfc7c3f-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Acquiring lock "cinder-c87b806f-7107-429a-81e8-9daa7a43a563-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Lock "cinder-c87b806f-7107-429a-81e8-9daa7a43a563-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Acquiring lock "cinder-quobyte-c87b806f-7107-429a-81e8-9daa7a43a563" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Lock "cinder-quobyte-c87b806f-7107-429a-81e8-9daa7a43a563" acquired by "delete_volume" :: waited 0.034s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:43 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47b543c-59db-42cb-8eb3-52cee8b0d262]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:44 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563 Jul 23 03:31:44 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:44 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563" returned: 0 in 0.489s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:44 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563 Jul 23 03:31:44 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:44 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c87b806f-7107-429a-81e8-9daa7a43a563" returned: 0 in 0.444s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Lock "cinder-quobyte-c87b806f-7107-429a-81e8-9daa7a43a563" released by "delete_volume" :: held 1.018s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:44 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Created reservations ['9027f9b4-2ea1-431d-b42d-4d1556c96944', '19ed392d-84c5-4eb1-ae3e-97bee6a3597d', '45277a4e-cf65-4c30-8c22-1ca0dcd3c1aa', 'f4b94398-4390-48e0-bc80-05ff842290c4'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:45 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:31:45 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-dd6d92a4-67a7-4048-bc98-8994517ff271 req-beddede4-4202-4e3c-b218-1c82ddbef7aa tempest-TestMinimumBasicScenario-1304232039 None] Terminate volume connection completed successfully. Jul 23 03:31:45 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-dd6d92a4-67a7-4048-bc98-8994517ff271 req-beddede4-4202-4e3c-b218-1c82ddbef7aa tempest-TestMinimumBasicScenario-1304232039 None] Deleting attachment ca7f7b33-0ada-41a0-b008-695a974cb056. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:31:45 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.365s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:45 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Deleted volume successfully. Jul 23 03:31:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0079e4e9-29a5-45c9-8e48-d14fd2da5b5b tempest-CinderUnicodeTest-919951574 None] Lock "cinder-c87b806f-7107-429a-81e8-9daa7a43a563-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Acquiring lock "cinder-0c0af710-be19-4c01-af1d-9600b8950a99-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Lock "cinder-0c0af710-be19-4c01-af1d-9600b8950a99-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Acquiring lock "cinder-quobyte-0c0af710-be19-4c01-af1d-9600b8950a99" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Lock "cinder-quobyte-0c0af710-be19-4c01-af1d-9600b8950a99" acquired by "delete_volume" :: waited 0.030s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:46 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37d6616-34d5-4e0f-8598-b603ad662340]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:46 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99 Jul 23 03:31:46 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:46 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99" returned: 0 in 0.442s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:46 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99 Jul 23 03:31:46 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:46 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c0af710-be19-4c01-af1d-9600b8950a99" returned: 0 in 0.320s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Lock "cinder-quobyte-0c0af710-be19-4c01-af1d-9600b8950a99" released by "delete_volume" :: held 0.814s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:47 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Created reservations ['2d3a223f-3e40-4711-ac9e-4f4fffdcf9dc', '08f2cd21-2d52-4b23-ba06-43a2da3ac1b6', '35fbe892-9d9e-4ddd-81a5-2714731d14d1', '26dc869b-26ef-471f-9dbd-2f31987b032c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:47 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:31:47 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:47 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.493s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:47 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Deleted volume successfully. Jul 23 03:31:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-476c0e00-fe0b-46d6-8f33-894bdf0bf455 tempest-TestMinimumBasicScenario-1304232039 None] Lock "cinder-0c0af710-be19-4c01-af1d-9600b8950a99-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:50 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Flow 'volume_create_manager' (d2a63e26-e895-4fa2-b64d-272a50078305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:50 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528f00dc-94a6-42d6-8a12-92f973b3b30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528f00dc-94a6-42d6-8a12-92f973b3b30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341738915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654aadda-7762-45a8-b663-c6b7d073c724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacca9dab21443288a917a6cb3ff9fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:51Z,use_quota=True,user_id='8cf95385dba7418b913dbb9c56a85263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296d087e-eba0-4524-9c8e-a67b81d4f310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296d087e-eba0-4524-9c8e-a67b81d4f310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f42403-148f-41a9-8fa7-d1e28f4b9cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f42403-148f-41a9-8fa7-d1e28f4b9cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '654aadda-7762-45a8-b663-c6b7d073c724', 'volume_name': 'volume-654aadda-7762-45a8-b663-c6b7d073c724', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83479ee2-2ee7-437c-b040-0798ebeaa28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83479ee2-2ee7-437c-b040-0798ebeaa28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0f067a-3ce4-4132-a5f9-82e84918731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:51 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Volume 654aadda-7762-45a8-b663-c6b7d073c724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-654aadda-7762-45a8-b663-c6b7d073c724', 'volume_size': 1} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341738915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654aadda-7762-45a8-b663-c6b7d073c724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacca9dab21443288a917a6cb3ff9fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:51Z,use_quota=True,user_id='8cf95385dba7418b913dbb9c56a85263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Creating volume 654aadda-7762-45a8-b663-c6b7d073c724 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:51 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:51 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724 1073741824 Jul 23 03:31:51 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:51 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724 1073741824" returned: 0 in 0.517s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:51 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724 Jul 23 03:31:51 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:51 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0f067a-3ce4-4132-a5f9-82e84918731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654aadda-7762-45a8-b663-c6b7d073c724', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e522815a-a943-45c1-adb5-4ed4bf82bca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:51 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Volume volume-654aadda-7762-45a8-b663-c6b7d073c724 (654aadda-7762-45a8-b663-c6b7d073c724): created successfully Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e522815a-a943-45c1-adb5-4ed4bf82bca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Flow 'volume_create_manager' (d2a63e26-e895-4fa2-b64d-272a50078305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:51 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7592c833-ac05-4cad-a834-ddbe2060c0ee tempest-ProjectReaderTests-1430206800 None] Created volume successfully. Jul 23 03:31:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "cinder-654aadda-7762-45a8-b663-c6b7d073c724-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-654aadda-7762-45a8-b663-c6b7d073c724-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "cinder-quobyte-654aadda-7762-45a8-b663-c6b7d073c724" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-quobyte-654aadda-7762-45a8-b663-c6b7d073c724" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:53 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cf9648-8f03-4d72-be3d-5a2224836360]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:53 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724 Jul 23 03:31:53 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:53 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724" returned: 0 in 0.389s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:53 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724 Jul 23 03:31:53 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:54 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-654aadda-7762-45a8-b663-c6b7d073c724" returned: 0 in 0.298s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-quobyte-654aadda-7762-45a8-b663-c6b7d073c724" released by "delete_volume" :: held 0.775s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Created reservations ['40fe78ec-ca30-4864-b8f1-1640eb07047b', '743e7231-03a0-4b21-9d11-d0a1953a44d9', '2c2b4639-2b54-46f0-b275-bcf75c05b198', 'd7cba85f-ca4d-432d-b601-5a72a3d4c890'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:54 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:31:54 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:54 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.292s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:54 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Deleted volume successfully. Jul 23 03:31:54 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8abcca06-e72c-4c7e-89dc-9e5fb77ace56 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-654aadda-7762-45a8-b663-c6b7d073c724-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Flow 'volume_create_manager' (779e6f5f-2612-4913-af39-d9a2d92d6877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487aa84d-39cd-4341-bae1-4749b0684099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487aa84d-39cd-4341-bae1-4749b0684099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-981031527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf4e000-f665-414a-9c06-e045f06597f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacca9dab21443288a917a6cb3ff9fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:55Z,use_quota=True,user_id='8cf95385dba7418b913dbb9c56a85263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843d9bcc-c621-4dcd-97b2-b22bef9e254d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843d9bcc-c621-4dcd-97b2-b22bef9e254d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46b4cfa-05ed-4fdb-8612-db174edfe8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46b4cfa-05ed-4fdb-8612-db174edfe8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf4e000-f665-414a-9c06-e045f06597f2', 'volume_name': 'volume-7bf4e000-f665-414a-9c06-e045f06597f2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e09d42-0f74-4c7a-9f79-9aa1bb90fafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e09d42-0f74-4c7a-9f79-9aa1bb90fafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a88b186-b0df-4b6f-b938-34dd04b495a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:55 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Volume 7bf4e000-f665-414a-9c06-e045f06597f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf4e000-f665-414a-9c06-e045f06597f2', 'volume_size': 1} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-981031527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf4e000-f665-414a-9c06-e045f06597f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacca9dab21443288a917a6cb3ff9fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:55Z,use_quota=True,user_id='8cf95385dba7418b913dbb9c56a85263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Creating volume 7bf4e000-f665-414a-9c06-e045f06597f2 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:55 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:55 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2 1073741824 Jul 23 03:31:55 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:55 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2 1073741824" returned: 0 in 0.452s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:55 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2 Jul 23 03:31:55 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:56 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2" returned: 0 in 0.312s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a88b186-b0df-4b6f-b938-34dd04b495a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf4e000-f665-414a-9c06-e045f06597f2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f7faa0-ffd9-42f5-b7d9-82b1ea8e0b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:56 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Volume volume-7bf4e000-f665-414a-9c06-e045f06597f2 (7bf4e000-f665-414a-9c06-e045f06597f2): created successfully Jul 23 03:31:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f7faa0-ffd9-42f5-b7d9-82b1ea8e0b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Flow 'volume_create_manager' (779e6f5f-2612-4913-af39-d9a2d92d6877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:56 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-87209c07-aec2-4166-8a21-959468fd8e04 tempest-ProjectReaderTests-1430206800 None] Created volume successfully. Jul 23 03:31:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "cinder-7bf4e000-f665-414a-9c06-e045f06597f2-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-7bf4e000-f665-414a-9c06-e045f06597f2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "cinder-quobyte-7bf4e000-f665-414a-9c06-e045f06597f2" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:31:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-quobyte-7bf4e000-f665-414a-9c06-e045f06597f2" acquired by "delete_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:31:57 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6cc593-f8a4-43dd-9cf2-d544988fa4ac]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:31:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:57 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2 Jul 23 03:31:57 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:57 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2" returned: 0 in 0.388s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:57 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2 Jul 23 03:31:57 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:58 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7bf4e000-f665-414a-9c06-e045f06597f2" returned: 0 in 0.305s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-quobyte-7bf4e000-f665-414a-9c06-e045f06597f2" released by "delete_volume" :: held 0.752s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Created reservations ['55f1e05c-8127-4565-bf37-7a5dddfe81ee', 'bd471184-1cab-4031-9ca8-7a6dbc63a08e', 'a7d374a0-6d70-43fc-bd04-9ceba53776c5', '9befc103-bc31-410c-b943-420b325cc6bf'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:58 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:31:58 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:58 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.307s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:31:58 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Deleted volume successfully. Jul 23 03:31:58 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a87b854a-6383-4135-bf3c-b5bbd49f2385 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-7bf4e000-f665-414a-9c06-e045f06597f2-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Flow 'volume_create_manager' (8a51793e-d197-499b-9789-6be64351e788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d47926f-346e-4107-8adf-a0855aa6f018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d47926f-346e-4107-8adf-a0855aa6f018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62668286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0313f15-e265-4a64-ab64-40a4ef8874c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacca9dab21443288a917a6cb3ff9fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:59Z,use_quota=True,user_id='8cf95385dba7418b913dbb9c56a85263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee886796-e0bf-467a-9056-4a151e95778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee886796-e0bf-467a-9056-4a151e95778c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c44d8d-b5d4-4a6c-a67a-dbd7f98e6c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c44d8d-b5d4-4a6c-a67a-dbd7f98e6c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0313f15-e265-4a64-ab64-40a4ef8874c9', 'volume_name': 'volume-e0313f15-e265-4a64-ab64-40a4ef8874c9', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00306745-ac03-4d2e-ad07-f8941cc9ae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00306745-ac03-4d2e-ad07-f8941cc9ae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e8e50b-a26f-4f3d-8d82-21d60a7d63ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:31:59 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Volume e0313f15-e265-4a64-ab64-40a4ef8874c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0313f15-e265-4a64-ab64-40a4ef8874c9', 'volume_size': 1} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62668286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0313f15-e265-4a64-ab64-40a4ef8874c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacca9dab21443288a917a6cb3ff9fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:31:59Z,use_quota=True,user_id='8cf95385dba7418b913dbb9c56a85263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Creating volume e0313f15-e265-4a64-ab64-40a4ef8874c9 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:31:59 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:59 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9 1073741824 Jul 23 03:31:59 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:59 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9 1073741824" returned: 0 in 0.525s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:31:59 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9 Jul 23 03:31:59 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:31:59 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9" returned: 0 in 0.257s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:31:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e8e50b-a26f-4f3d-8d82-21d60a7d63ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0313f15-e265-4a64-ab64-40a4ef8874c9', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6e54eb-c6a4-4019-ae46-f225d51d6636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:00 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Volume volume-e0313f15-e265-4a64-ab64-40a4ef8874c9 (e0313f15-e265-4a64-ab64-40a4ef8874c9): created successfully Jul 23 03:32:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6e54eb-c6a4-4019-ae46-f225d51d6636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:00 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Flow 'volume_create_manager' (8a51793e-d197-499b-9789-6be64351e788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:00 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ff0a63b3-3861-4347-8877-0caec7b3dfef tempest-ProjectReaderTests-1430206800 None] Created volume successfully. Jul 23 03:32:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "cinder-e0313f15-e265-4a64-ab64-40a4ef8874c9-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-e0313f15-e265-4a64-ab64-40a4ef8874c9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "cinder-quobyte-e0313f15-e265-4a64-ab64-40a4ef8874c9" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-quobyte-e0313f15-e265-4a64-ab64-40a4ef8874c9" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:01 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce36d0a-cff5-4c23-8035-5a8032c3bdbe]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:01 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9 Jul 23 03:32:01 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:01 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9" returned: 0 in 0.410s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:01 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9 Jul 23 03:32:01 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:01 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-e0313f15-e265-4a64-ab64-40a4ef8874c9" returned: 0 in 0.250s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-quobyte-e0313f15-e265-4a64-ab64-40a4ef8874c9" released by "delete_volume" :: held 0.721s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Created reservations ['9bcd0df8-d4d4-4dcd-9edf-db3b8944f467', '09fe6f74-15e2-4fc5-b3fe-ea31535e156b', 'e2a6897e-128f-40b3-b8a3-a032914f9b41', '5da27f2f-3d96-410e-90dd-133e53d6345d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:02 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:02 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:02 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.265s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:02 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Deleted volume successfully. Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f923651b-ad45-4960-ab87-5c21bdc13575 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-e0313f15-e265-4a64-ab64-40a4ef8874c9-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Flow 'volume_create_manager' (fa69b6fe-d19e-4615-a340-63458bc1e5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f76ca3-e3e4-428e-be5a-5b366d5c9571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f76ca3-e3e4-428e-be5a-5b366d5c9571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1951285547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a8a94d-8184-4ffa-a276-dbc04a2e60f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacca9dab21443288a917a6cb3ff9fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:03Z,use_quota=True,user_id='8cf95385dba7418b913dbb9c56a85263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320da482-89f0-454b-a184-586b8249d245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320da482-89f0-454b-a184-586b8249d245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33c9437-1489-4326-b7c0-8a29865fc65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33c9437-1489-4326-b7c0-8a29865fc65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a8a94d-8184-4ffa-a276-dbc04a2e60f2', 'volume_name': 'volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ee6ae2-902d-41ed-869c-7633d807a1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ee6ae2-902d-41ed-869c-7633d807a1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503701fb-c633-4ad0-a514-b191df501468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:02 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Volume d6a8a94d-8184-4ffa-a276-dbc04a2e60f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2', 'volume_size': 1} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1951285547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a8a94d-8184-4ffa-a276-dbc04a2e60f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacca9dab21443288a917a6cb3ff9fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:03Z,use_quota=True,user_id='8cf95385dba7418b913dbb9c56a85263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Creating volume d6a8a94d-8184-4ffa-a276-dbc04a2e60f2 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:02 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:02 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2 1073741824 Jul 23 03:32:02 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:03 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2 1073741824" returned: 0 in 0.504s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:03 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2 Jul 23 03:32:03 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:03 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2" returned: 0 in 0.246s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503701fb-c633-4ad0-a514-b191df501468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff002f79-a3ec-446d-a6fe-d8729117b89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:03 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Volume volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2 (d6a8a94d-8184-4ffa-a276-dbc04a2e60f2): created successfully Jul 23 03:32:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff002f79-a3ec-446d-a6fe-d8729117b89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Flow 'volume_create_manager' (fa69b6fe-d19e-4615-a340-63458bc1e5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:03 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1b6c938b-29d2-4467-8139-41eb76142844 tempest-ProjectReaderTests-1430206800 None] Created volume successfully. Jul 23 03:32:04 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Flow 'volume_create_manager' (343b3b73-9de0-42cf-a670-a612933d1c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb595c9-b240-41fb-b7cd-84af899063d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb595c9-b240-41fb-b7cd-84af899063d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2fb54d-c22d-4bbf-a250-a27551cd9daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5978f496ef8543aa87521afa4d01b6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:05Z,use_quota=True,user_id='deb618b297244402bbcb0b3312f0c572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1b13a16-15fd-4f7a-9624-c28ccdbe7827),volume_type_id=a1b13a16-15fd-4f7a-9624-c28ccdbe7827)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d157144-b783-4bed-a3d4-e9decc65c396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d157144-b783-4bed-a3d4-e9decc65c396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7d4538-924b-4826-bcc4-6578f75c4127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:04 devstack cinder-volume[88392]: DEBUG cinder.image.glance [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Creating Keystone auth plugin from conf {{(pid=88392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:32:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "cinder-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "cinder-quobyte-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-quobyte-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2" acquired by "delete_volume" :: waited 0.013s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf661ba-e60e-47a8-81af-9a557d2e6702]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7d4538-924b-4826-bcc4-6578f75c4127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4f2fb54d-c22d-4bbf-a250-a27551cd9daa', 'volume_name': 'volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa', 'volume_size': 1, 'image_id': '00e3c323-4e88-470f-a247-9a490ceaa6c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00e3c323-4e88-470f-a247-9a490ceaa6c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afd3bef3aab280fef3ea8cdc80d4eee4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5978f496ef8543aa87521afa4d01b6ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0ccae7c6b97f0c1e3530bc461f8bdab881cf0fc2b1d0f64a89eba177369bdb9a70c3462bcab90de92bbbf2070700d49a01c35b5ef20316293a3128b9a8d4c6d', 'id': '00e3c323-4e88-470f-a247-9a490ceaa6c5', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00e3c323-4e88-470f-a247-9a490ceaa6c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9c1074-4397-42e1-a75d-af3e86f05db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9c1074-4397-42e1-a75d-af3e86f05db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cf5fd8-4688-412f-a8be-a65427ccf221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:05 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Volume 4f2fb54d-c22d-4bbf-a250-a27551cd9daa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa', 'volume_size': 1, 'image_id': '00e3c323-4e88-470f-a247-9a490ceaa6c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00e3c323-4e88-470f-a247-9a490ceaa6c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afd3bef3aab280fef3ea8cdc80d4eee4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5978f496ef8543aa87521afa4d01b6ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0ccae7c6b97f0c1e3530bc461f8bdab881cf0fc2b1d0f64a89eba177369bdb9a70c3462bcab90de92bbbf2070700d49a01c35b5ef20316293a3128b9a8d4c6d', 'id': '00e3c323-4e88-470f-a247-9a490ceaa6c5', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00e3c323-4e88-470f-a247-9a490ceaa6c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Trying to clone 4f2fb54d-c22d-4bbf-a250-a27551cd9daa from image 00e3c323-4e88-470f-a247-9a490ceaa6c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/00e3c323-4e88-470f-a247-9a490ceaa6c5', 'metadata': {}}]). {{(pid=88392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:32:05 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2 Jul 23 03:32:05 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:32:05 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[587bf924-2cce-4c64-ac8c-28d64728c3e4]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:05 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD Jul 23 03:32:05 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:05 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2" returned: 0 in 0.410s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:05 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2 Jul 23 03:32:05 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:05 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:05 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2" returned: 0 in 0.270s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-quobyte-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2" released by "delete_volume" :: held 0.723s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:05 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD Jul 23 03:32:05 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Created reservations ['70ea456b-c95a-4354-8359-c6d39fe839cf', '6e06579e-549d-46c9-9081-aafc89ea6f52', 'e86d28c1-5120-4d69-bc35-7f7056cda94d', '0e317114-a7cb-4e22-b67e-845f17cadc63'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:05 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:05 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:06 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Temporary image 00e3c323-4e88-470f-a247-9a490ceaa6c5 is fetched for user deb618b297244402bbcb0b3312f0c572. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a08c943-9f72-419a-92d5-38d417b92d81]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:06 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.278s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:06 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Deleted volume successfully. Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-487fd5d4-f995-4909-9a42-cd7264ce1b25 tempest-ProjectReaderTests-1430206800 None] Lock "cinder-d6a8a94d-8184-4ffa-a276-dbc04a2e60f2-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:06 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD Jul 23 03:32:06 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:06 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:06 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD Jul 23 03:32:06 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:06 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2fb54d-c22d-4bbf-a250-a27551cd9daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5978f496ef8543aa87521afa4d01b6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:05Z,use_quota=True,user_id='deb618b297244402bbcb0b3312f0c572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1b13a16-15fd-4f7a-9624-c28ccdbe7827),volume_type_id=a1b13a16-15fd-4f7a-9624-c28ccdbe7827)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Creating volume 4f2fb54d-c22d-4bbf-a250-a27551cd9daa {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:06 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:06 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa 1073741824 Jul 23 03:32:06 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:06 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:06 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:07 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.294s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:32:07 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa 1073741824" returned: 0 in 0.538s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=94,cinder:UPDATE=109,cinder:INSERT=26,cinder:DELETE=7 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:07 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa Jul 23 03:32:07 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:07 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa" returned: 0 in 0.262s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Attempting download of 00e3c323-4e88-470f-a247-9a490ceaa6c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/00e3c323-4e88-470f-a247-9a490ceaa6c5', 'metadata': {}}])) to volume 4f2fb54d-c22d-4bbf-a250-a27551cd9daa. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[32336853-80de-4670-9031-fd057603dbe8]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00e3c323-4e88-470f-a247-9a490ceaa6c5_ga08aync {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:07 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00e3c323-4e88-470f-a247-9a490ceaa6c5_ga08aync Jul 23 03:32:07 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:08 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00e3c323-4e88-470f-a247-9a490ceaa6c5_ga08aync" returned: 0 in 0.367s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00e3c323-4e88-470f-a247-9a490ceaa6c5_ga08aync {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:08 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00e3c323-4e88-470f-a247-9a490ceaa6c5_ga08aync Jul 23 03:32:08 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:08 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00e3c323-4e88-470f-a247-9a490ceaa6c5_ga08aync" returned: 1 in 0.319s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00e3c323-4e88-470f-a247-9a490ceaa6c5_ga08aync' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:32:08 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc43ed52-3c34-4ecd-b4ae-1086c3e68d5c]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:08 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD Jul 23 03:32:08 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:08 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD" returned: 0 in 0.300s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:08 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD Jul 23 03:32:08 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:09 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD" returned: 1 in 0.307s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] 00e3c323-4e88-470f-a247-9a490ceaa6c5 was raw, converting to qcow2 {{(pid=88392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:09 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa Jul 23 03:32:09 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:09 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa" returned: 0 in 0.408s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00e3c323-4e88-470f-a247-9a490ceaa6c5_7ju2tzasdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:32:09 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:09 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa 1G Jul 23 03:32:09 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:09 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa 1G" returned: 0 in 0.278s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Downloaded image 00e3c323-4e88-470f-a247-9a490ceaa6c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/00e3c323-4e88-470f-a247-9a490ceaa6c5', 'metadata': {}}])) to volume 4f2fb54d-c22d-4bbf-a250-a27551cd9daa successfully. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Temporary image 00e3c323-4e88-470f-a247-9a490ceaa6c5 for user deb618b297244402bbcb0b3312f0c572 is deleted. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Marking volume 4f2fb54d-c22d-4bbf-a250-a27551cd9daa as bootable. {{(pid=88392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Copying metadata from image 00e3c323-4e88-470f-a247-9a490ceaa6c5 to 4f2fb54d-c22d-4bbf-a250-a27551cd9daa. {{(pid=88392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Creating volume glance metadata for volume 4f2fb54d-c22d-4bbf-a250-a27551cd9daa backed by image 00e3c323-4e88-470f-a247-9a490ceaa6c5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '00e3c323-4e88-470f-a247-9a490ceaa6c5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'afd3bef3aab280fef3ea8cdc80d4eee4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cf5fd8-4688-412f-a8be-a65427ccf221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa', 'volume_size': 1, 'image_id': '00e3c323-4e88-470f-a247-9a490ceaa6c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00e3c323-4e88-470f-a247-9a490ceaa6c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afd3bef3aab280fef3ea8cdc80d4eee4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5978f496ef8543aa87521afa4d01b6ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0ccae7c6b97f0c1e3530bc461f8bdab881cf0fc2b1d0f64a89eba177369bdb9a70c3462bcab90de92bbbf2070700d49a01c35b5ef20316293a3128b9a8d4c6d', 'id': '00e3c323-4e88-470f-a247-9a490ceaa6c5', 'created_at': datetime.datetime(2026, 7, 23, 1, 32, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 32, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00e3c323-4e88-470f-a247-9a490ceaa6c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6752bb47-6905-41ed-8675-61938d2b80ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:09 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Volume volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa (4f2fb54d-c22d-4bbf-a250-a27551cd9daa): created successfully Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6752bb47-6905-41ed-8675-61938d2b80ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Flow 'volume_create_manager' (343b3b73-9de0-42cf-a670-a612933d1c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:09 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0cde0d22-78ac-4383-84a3-bb79150c6b22 tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Created volume successfully. Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Acquiring lock "cinder-4f2fb54d-c22d-4bbf-a250-a27551cd9daa-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Lock "cinder-4f2fb54d-c22d-4bbf-a250-a27551cd9daa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Acquiring lock "cinder-quobyte-4f2fb54d-c22d-4bbf-a250-a27551cd9daa" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Lock "cinder-quobyte-4f2fb54d-c22d-4bbf-a250-a27551cd9daa" acquired by "delete_volume" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcadf76-071a-4009-b5f6-9fc6b8571bc7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:10 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa Jul 23 03:32:10 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:10 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa" returned: 0 in 0.342s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:10 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa Jul 23 03:32:10 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:10 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4f2fb54d-c22d-4bbf-a250-a27551cd9daa" returned: 0 in 0.235s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Lock "cinder-quobyte-4f2fb54d-c22d-4bbf-a250-a27551cd9daa" released by "delete_volume" :: held 0.612s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:10 devstack cinder-volume[88392]: WARNING cinder.quota [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:32:10 devstack cinder-volume[88392]: WARNING cinder.quota [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Created reservations ['c378efac-136f-4f4b-baa0-f6b46c1d379a', 'b42c3bb2-e12b-4865-a9fe-6c05351b03e5', '64f40a9b-f272-4eea-a739-512c23d831a9', 'a823545b-a3e7-477c-9ce0-891a9ad94de8'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:10 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:10 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:11 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.227s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:11 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Deleted volume successfully. Jul 23 03:32:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-362b68bf-0a29-4dec-b700-22a1238eccca tempest-VolumeAndVolumeTypeFromImageTest-1861301799 None] Lock "cinder-4f2fb54d-c22d-4bbf-a250-a27551cd9daa-delete_volume" released by "delete_volume" :: held 1.022s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (9b4854c5-cad1-4259-92b3-f34b8f534990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d009b9-e13e-4c02-8e71-90ce2f150e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d009b9-e13e-4c02-8e71-90ce2f150e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1559406615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f57025c-6503-4903-a173-173a1b89e65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:15Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976fe9c8-8700-4f78-9071-edc01e5ec94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976fe9c8-8700-4f78-9071-edc01e5ec94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68263d39-eb4b-42c3-b04e-82eef0595355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68263d39-eb4b-42c3-b04e-82eef0595355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f57025c-6503-4903-a173-173a1b89e65c', 'volume_name': 'volume-3f57025c-6503-4903-a173-173a1b89e65c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9721132e-85f3-4a19-8a3c-bd7ba603fd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9721132e-85f3-4a19-8a3c-bd7ba603fd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dff5506-05b4-4092-b4fa-afda8dde46d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:15 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume 3f57025c-6503-4903-a173-173a1b89e65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f57025c-6503-4903-a173-173a1b89e65c', 'volume_size': 1} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1559406615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f57025c-6503-4903-a173-173a1b89e65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:15Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Creating volume 3f57025c-6503-4903-a173-173a1b89e65c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:15 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:15 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c 1073741824 Jul 23 03:32:15 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:15 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c 1073741824" returned: 0 in 0.399s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:15 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c Jul 23 03:32:15 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:16 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c" returned: 0 in 0.248s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dff5506-05b4-4092-b4fa-afda8dde46d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f57025c-6503-4903-a173-173a1b89e65c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b1d37c-41aa-4017-ae82-8b929f25f53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:16 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume volume-3f57025c-6503-4903-a173-173a1b89e65c (3f57025c-6503-4903-a173-173a1b89e65c): created successfully Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b1d37c-41aa-4017-ae82-8b929f25f53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (9b4854c5-cad1-4259-92b3-f34b8f534990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a34889f9-4430-4400-ab61-3667cba4275d tempest-CreateVolumesFromSnapshotTest-641257769 None] Created volume successfully. Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] Creating offline snapshot 3d947234-a03b-4484-bfaf-a380fda2bb6b of volume 3f57025c-6503-4903-a173-173a1b89e65c {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5af5f3c-d658-4150-98c5-042cce41f378]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:16 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c Jul 23 03:32:16 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:16 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c" returned: 0 in 0.338s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:16 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b 1G Jul 23 03:32:16 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:17 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b 1G" returned: 0 in 0.395s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f57025c-6503-4903-a173-173a1b89e65c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:17 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f57025c-6503-4903-a173-173a1b89e65c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b Jul 23 03:32:17 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:17 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f57025c-6503-4903-a173-173a1b89e65c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b" returned: 0 in 0.291s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:17 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b is being set with open permissions: ugo+rw Jul 23 03:32:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:17 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b Jul 23 03:32:17 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:17 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b" returned: 0 in 0.235s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:17 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.info Jul 23 03:32:17 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:18 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.info" returned: 0 in 0.240s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:18 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.info is being set with open permissions: ugo+rw Jul 23 03:32:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:18 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.info Jul 23 03:32:18 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:18 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.info" returned: 0 in 0.232s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:18 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ffda8156-61ba-4327-85e0-21de5b1973ff tempest-CreateVolumesFromSnapshotTest-641257769 None] Create snapshot completed successfully Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (a42f624b-7eb4-4c83-8549-693b4f0c7cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174b294c-5dad-4411-a066-73a0a52c5576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174b294c-5dad-4411-a066-73a0a52c5576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1733314366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98988b2-39ad-4ed3-bbf3-4262f077f01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:19Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aeac31-c7e3-4aa8-8bcc-ca10339d35d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21aeac31-c7e3-4aa8-8bcc-ca10339d35d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc3e2cd-31ca-4f72-9941-b1b4bdc981c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc3e2cd-31ca-4f72-9941-b1b4bdc981c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd98988b2-39ad-4ed3-bbf3-4262f077f01c', 'volume_name': 'volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f2a247-1f49-4bd6-841a-872d8655b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f2a247-1f49-4bd6-841a-872d8655b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa71b83-7bcd-43e8-b03e-6f2c23a8b865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume d98988b2-39ad-4ed3-bbf3-4262f077f01c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c', 'volume_size': 1} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1733314366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98988b2-39ad-4ed3-bbf3-4262f077f01c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:19Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Creating volume d98988b2-39ad-4ed3-bbf3-4262f077f01c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:19 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:19 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c 1073741824 Jul 23 03:32:19 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (492ffdbf-ee43-41c9-91b3-b7cbf5023377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7f2db3-7e3d-4f86-a332-6395d4d4447b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7f2db3-7e3d-4f86-a332-6395d4d4447b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-266836906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfcb685-0882-4a6f-affc-0a0fb7218cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:19Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef85dd3-ce58-4dc1-8e0b-8f5a59fa5bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef85dd3-ce58-4dc1-8e0b-8f5a59fa5bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a5a5c0-bba3-4096-a377-96b51ccc9070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a5a5c0-bba3-4096-a377-96b51ccc9070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cfcb685-0882-4a6f-affc-0a0fb7218cc7', 'volume_name': 'volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cc485b-a121-4148-b552-f233b5f37b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cc485b-a121-4148-b552-f233b5f37b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e368bd-a07c-457a-9029-1d7408319507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume 7cfcb685-0882-4a6f-affc-0a0fb7218cc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7', 'volume_size': 1} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:19 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c 1073741824" returned: 0 in 0.516s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:19 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c Jul 23 03:32:19 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (765b3aef-bb87-47d7-8f71-413a38bf6e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fc2edc-42ac-49f8-83d2-91c27ffb5b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fc2edc-42ac-49f8-83d2-91c27ffb5b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1027948224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10511d7d-bd31-4d73-a227-4b7aea1bfce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:20Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef096d21-9fae-4edb-b212-eb4c3749ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef096d21-9fae-4edb-b212-eb4c3749ae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099d88dc-2b3b-401e-90b1-0d686d33bc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099d88dc-2b3b-401e-90b1-0d686d33bc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10511d7d-bd31-4d73-a227-4b7aea1bfce1', 'volume_name': 'volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2e5ce0-3961-4809-97a8-688e2da7debb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2e5ce0-3961-4809-97a8-688e2da7debb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cde81d7-3081-46fb-9c8e-fcde14441a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:19 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume 10511d7d-bd31-4d73-a227-4b7aea1bfce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1', 'volume_size': 1} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:19 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c" returned: 0 in 0.247s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-266836906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfcb685-0882-4a6f-affc-0a0fb7218cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:19Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Creating volume 7cfcb685-0882-4a6f-affc-0a0fb7218cc7 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:19 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:20 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7 1073741824 Jul 23 03:32:20 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa71b83-7bcd-43e8-b03e-6f2c23a8b865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b03b431-dbc4-42ec-8e3c-8ab50e057bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c (d98988b2-39ad-4ed3-bbf3-4262f077f01c): created successfully Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b03b431-dbc4-42ec-8e3c-8ab50e057bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (a42f624b-7eb4-4c83-8549-693b4f0c7cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:20 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-663ae9cd-6c4a-46aa-8f0e-a149ff9554b2 tempest-CreateVolumesFromSnapshotTest-641257769 None] Created volume successfully. Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (451095f5-b36e-4118-a228-54d98c7a5751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62356873-abe7-47c7-a6ee-04649c84127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62356873-abe7-47c7-a6ee-04649c84127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-326180404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25994112-d84f-48f0-ad45-f05711d64f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:20Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5775e2-bd86-4d16-b156-5167c0cb7217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5775e2-bd86-4d16-b156-5167c0cb7217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eac3cb9-438a-4d17-8cb6-3ab055e07d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eac3cb9-438a-4d17-8cb6-3ab055e07d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25994112-d84f-48f0-ad45-f05711d64f2c', 'volume_name': 'volume-25994112-d84f-48f0-ad45-f05711d64f2c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1783a3-80c3-40f6-9c8d-290b95679f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1783a3-80c3-40f6-9c8d-290b95679f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953722cf-efd8-4b9f-8e9c-4d2e5521a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume 25994112-d84f-48f0-ad45-f05711d64f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25994112-d84f-48f0-ad45-f05711d64f2c', 'volume_size': 1} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:20 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7 1073741824" returned: 0 in 0.547s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:20 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7 Jul 23 03:32:20 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (7c4e17ec-ac72-40c9-8236-080a89f890d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e02940-a82c-4afd-a671-b2174cc60afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e02940-a82c-4afd-a671-b2174cc60afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-630751224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9ffffe-918c-4611-b29e-9841477f9d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:21Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cecb35-cc4e-42d4-8b58-b61f9a377f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74cecb35-cc4e-42d4-8b58-b61f9a377f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bfd5db-e726-42a9-9955-13b35f0032ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bfd5db-e726-42a9-9955-13b35f0032ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa9ffffe-918c-4611-b29e-9841477f9d12', 'volume_name': 'volume-fa9ffffe-918c-4611-b29e-9841477f9d12', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c815f7ec-acf1-4e6b-8153-195d318995e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c815f7ec-acf1-4e6b-8153-195d318995e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4266b2c4-fa18-4859-84c5-508bdd81c72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume fa9ffffe-918c-4611-b29e-9841477f9d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa9ffffe-918c-4611-b29e-9841477f9d12', 'volume_size': 1} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:20 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7" returned: 0 in 0.253s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1027948224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10511d7d-bd31-4d73-a227-4b7aea1bfce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:20Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Creating volume 10511d7d-bd31-4d73-a227-4b7aea1bfce1 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:20 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e368bd-a07c-457a-9029-1d7408319507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd37384-9878-41a8-8d7c-9c09ec96dcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:20 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1 1073741824 Jul 23 03:32:20 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:20 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7 (7cfcb685-0882-4a6f-affc-0a0fb7218cc7): created successfully Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd37384-9878-41a8-8d7c-9c09ec96dcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (492ffdbf-ee43-41c9-91b3-b7cbf5023377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:20 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1f9ebbef-a159-43e3-abda-8beadba84eeb tempest-CreateVolumesFromSnapshotTest-641257769 None] Created volume successfully. Jul 23 03:32:21 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1 1073741824" returned: 0 in 0.455s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:21 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1 Jul 23 03:32:21 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:21 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1" returned: 0 in 0.291s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.334s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-326180404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25994112-d84f-48f0-ad45-f05711d64f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:20Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Creating volume 25994112-d84f-48f0-ad45-f05711d64f2c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:21 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:21 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c 1073741824 Jul 23 03:32:21 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cde81d7-3081-46fb-9c8e-fcde14441a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66aa24d-219c-4f4d-a8aa-bd4c00bf4f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:21 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1 (10511d7d-bd31-4d73-a227-4b7aea1bfce1): created successfully Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66aa24d-219c-4f4d-a8aa-bd4c00bf4f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (765b3aef-bb87-47d7-8f71-413a38bf6e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:21 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6f82f2f0-7a14-4e9d-b932-0f9a2736f687 tempest-CreateVolumesFromSnapshotTest-641257769 None] Created volume successfully. Jul 23 03:32:22 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c 1073741824" returned: 0 in 0.569s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:22 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c Jul 23 03:32:22 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:22 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c" returned: 0 in 0.386s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.983s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-630751224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9ffffe-918c-4611-b29e-9841477f9d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75ed09887b4461e8bceddab9a8401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:21Z,use_quota=True,user_id='a154bd88c6124096b3e5a1bbb4bd83fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Creating volume fa9ffffe-918c-4611-b29e-9841477f9d12 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:22 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953722cf-efd8-4b9f-8e9c-4d2e5521a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25994112-d84f-48f0-ad45-f05711d64f2c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:22 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12 1073741824 Jul 23 03:32:22 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f33153-4a4e-468f-99ee-9c82e27f51e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:22 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume volume-25994112-d84f-48f0-ad45-f05711d64f2c (25994112-d84f-48f0-ad45-f05711d64f2c): created successfully Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f33153-4a4e-468f-99ee-9c82e27f51e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:22 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (451095f5-b36e-4118-a228-54d98c7a5751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:22 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9b0065c4-47bd-4dc8-8ed5-d0c17a62fa64 tempest-CreateVolumesFromSnapshotTest-641257769 None] Created volume successfully. Jul 23 03:32:23 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12 1073741824" returned: 0 in 0.553s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:23 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12 Jul 23 03:32:23 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:23 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12" returned: 0 in 0.252s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4266b2c4-fa18-4859-84c5-508bdd81c72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9ffffe-918c-4611-b29e-9841477f9d12', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8382b7a-9d6c-47c0-8f1d-ab2b6d901f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:23 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Volume volume-fa9ffffe-918c-4611-b29e-9841477f9d12 (fa9ffffe-918c-4611-b29e-9841477f9d12): created successfully Jul 23 03:32:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8382b7a-9d6c-47c0-8f1d-ab2b6d901f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Flow 'volume_create_manager' (7c4e17ec-ac72-40c9-8236-080a89f890d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a317ca57-a95d-4fba-987d-56268bfcfb88 tempest-CreateVolumesFromSnapshotTest-641257769 None] Created volume successfully. Jul 23 03:32:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-b8139ef8-92cf-4041-8dcc-fe04b20e2874 tempest-TestShelveInstance-44177405 None] Terminate volume connection completed successfully. Jul 23 03:32:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-b8139ef8-92cf-4041-8dcc-fe04b20e2874 tempest-TestShelveInstance-44177405 None] Deleting attachment 58634aa0-91a9-4081-9290-9841641f7380. {{(pid=88392) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Acquiring lock "cinder-c5c5f763-9908-4a4c-8044-9abd778fd28b-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Lock "cinder-c5c5f763-9908-4a4c-8044-9abd778fd28b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Acquiring lock "cinder-quobyte-c5c5f763-9908-4a4c-8044-9abd778fd28b" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Lock "cinder-quobyte-c5c5f763-9908-4a4c-8044-9abd778fd28b" acquired by "delete_volume" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[348045d5-b5b9-4cda-915a-f0c3531f03cf]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-fa9ffffe-918c-4611-b29e-9841477f9d12-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-fa9ffffe-918c-4611-b29e-9841477f9d12-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-quobyte-fa9ffffe-918c-4611-b29e-9841477f9d12" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:24 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b Jul 23 03:32:24 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-fa9ffffe-918c-4611-b29e-9841477f9d12" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9951ea-7b4c-4b12-807f-d55643d4b6c1]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:24 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12 Jul 23 03:32:24 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:24 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b" returned: 0 in 0.470s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:24 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b Jul 23 03:32:24 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:24 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12" returned: 0 in 0.430s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:24 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12 Jul 23 03:32:24 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:24 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c5c5f763-9908-4a4c-8044-9abd778fd28b" returned: 0 in 0.308s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Lock "cinder-quobyte-c5c5f763-9908-4a4c-8044-9abd778fd28b" released by "delete_volume" :: held 0.840s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:24 devstack cinder-volume[88392]: DEBUG cinder.quota [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Created reservations ['1c6c8925-f62c-4236-b880-c5f0ed1b1c0c', '8705ca78-e8a6-482b-ab12-5105c1604c62', 'd142fd77-2854-45d8-9277-a885104d9497', '4c317cc4-5d04-432f-a0f2-5b973e602892'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:25 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fa9ffffe-918c-4611-b29e-9841477f9d12" returned: 0 in 0.277s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-fa9ffffe-918c-4611-b29e-9841477f9d12" released by "delete_volume" :: held 0.763s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:25 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:25 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Created reservations ['a734e836-9e62-42e5-8719-f90e887460dc', 'c8752516-a3dc-4b50-9e25-9bcea42da6d9', 'ba4bd2ca-5da4-4a5e-820b-e6a5cce702ff', '80b1f486-3cfc-4608-943e-d34cfe1376cf'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:25 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:25 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:25 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.373s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.manager [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Deleted volume successfully. Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-25994112-d84f-48f0-ad45-f05711d64f2c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [req-ad814b5c-43c3-4129-a27c-63c507e3259c req-0fc60b19-e9b6-4161-944b-11cd4c5692ac tempest-TestShelveInstance-44177405 None] Lock "cinder-c5c5f763-9908-4a4c-8044-9abd778fd28b-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-25994112-d84f-48f0-ad45-f05711d64f2c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-quobyte-25994112-d84f-48f0-ad45-f05711d64f2c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-25994112-d84f-48f0-ad45-f05711d64f2c" acquired by "delete_volume" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf59f58-a317-436b-bcb9-c886e7bb0a4d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:25 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.356s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Deleted volume successfully. Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-a3036d8b-9a89-4325-a759-23cdc7d4796f tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-fa9ffffe-918c-4611-b29e-9841477f9d12-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:25 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c Jul 23 03:32:25 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:25 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c" returned: 0 in 0.361s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:25 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c Jul 23 03:32:25 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:26 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-25994112-d84f-48f0-ad45-f05711d64f2c" returned: 0 in 0.257s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-25994112-d84f-48f0-ad45-f05711d64f2c" released by "delete_volume" :: held 0.658s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Created reservations ['60c06a0d-71cc-4141-96b4-6a8fc4fa1663', '2067173e-08e7-4bc5-b86b-d149ed161f27', 'c053cdc7-3f4a-490e-aace-826c2bfd5e64', 'd1bcde8f-7d1f-4e56-bc0f-7ca8987f4270'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:26 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:26 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:26 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.288s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:26 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Deleted volume successfully. Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-10511d7d-bd31-4d73-a227-4b7aea1bfce1-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-10511d7d-bd31-4d73-a227-4b7aea1bfce1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-01415ffc-10e0-4566-b8e7-88ff09b9b224 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-25994112-d84f-48f0-ad45-f05711d64f2c-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-quobyte-10511d7d-bd31-4d73-a227-4b7aea1bfce1" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-10511d7d-bd31-4d73-a227-4b7aea1bfce1" acquired by "delete_volume" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee323bc-326c-4ee9-8c08-c70472f2aa29]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:26 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1 Jul 23 03:32:26 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:27 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1" returned: 0 in 0.372s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:27 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1 Jul 23 03:32:27 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:27 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-10511d7d-bd31-4d73-a227-4b7aea1bfce1" returned: 0 in 0.256s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-10511d7d-bd31-4d73-a227-4b7aea1bfce1" released by "delete_volume" :: held 0.673s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Created reservations ['5263dbb1-47f2-4597-a28c-851b3c2cbb2c', '2e9bcc9b-851c-4819-aaa8-508b9b739bee', 'ab493051-1b41-4b7f-b396-2118bf75dc9e', 'c3a833dc-0c4a-4ec2-a71c-e3732f6b1d90'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:27 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:27 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:27 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.272s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:27 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Deleted volume successfully. Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-7cfcb685-0882-4a6f-affc-0a0fb7218cc7-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2bb12254-2125-46d7-a67c-218ce0d1a700 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-10511d7d-bd31-4d73-a227-4b7aea1bfce1-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-7cfcb685-0882-4a6f-affc-0a0fb7218cc7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-quobyte-7cfcb685-0882-4a6f-affc-0a0fb7218cc7" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-7cfcb685-0882-4a6f-affc-0a0fb7218cc7" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b00f64-b309-48f8-b776-5d5cc74b24a8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:28 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7 Jul 23 03:32:28 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:28 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7" returned: 0 in 0.406s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:28 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7 Jul 23 03:32:28 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:28 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cfcb685-0882-4a6f-affc-0a0fb7218cc7" returned: 0 in 0.247s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-7cfcb685-0882-4a6f-affc-0a0fb7218cc7" released by "delete_volume" :: held 0.703s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:28 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Created reservations ['db39aa4c-f16f-4a0f-9d22-e43834442678', '51a9d6dc-99f2-4ddc-8a19-48d45e257965', 'ac8446eb-b2b6-4696-83e5-26fbbef2cd6e', '2bd10dd2-4a06-4a4d-ad39-919c91137f9f'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:28 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:28 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:29 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.274s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:29 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Deleted volume successfully. Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-d98988b2-39ad-4ed3-bbf3-4262f077f01c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-dfae42d3-4f36-471a-ac89-019add8a827b tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-7cfcb685-0882-4a6f-affc-0a0fb7218cc7-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-d98988b2-39ad-4ed3-bbf3-4262f077f01c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-quobyte-d98988b2-39ad-4ed3-bbf3-4262f077f01c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-d98988b2-39ad-4ed3-bbf3-4262f077f01c" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd7196a-a56d-45d5-bac2-3a695221689e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:29 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c Jul 23 03:32:29 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:29 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c" returned: 0 in 0.399s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:29 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c Jul 23 03:32:29 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:29 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d98988b2-39ad-4ed3-bbf3-4262f077f01c" returned: 0 in 0.291s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-d98988b2-39ad-4ed3-bbf3-4262f077f01c" released by "delete_volume" :: held 0.742s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:29 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Created reservations ['0407a9a2-7abd-4609-9a1f-1e67fee44c98', 'cb14d8ca-cc11-410e-a455-5fddc8fa94c2', 'ea3a09c1-2646-420d-88fc-d31d7033f8f6', '79741054-5b89-43f8-91cb-31da0f775cf7'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:30 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:30 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-3d947234-a03b-4484-bfaf-a380fda2bb6b-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:30 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.256s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-3d947234-a03b-4484-bfaf-a380fda2bb6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-quobyte-3f57025c-6503-4903-a173-173a1b89e65c" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Deleted volume successfully. Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-3f57025c-6503-4903-a173-173a1b89e65c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-quobyte-3d947234-a03b-4484-bfaf-a380fda2bb6b" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-824b7552-01b5-4d0d-9e43-850c56c88ee3 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-d98988b2-39ad-4ed3-bbf3-4262f077f01c-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-3d947234-a03b-4484-bfaf-a380fda2bb6b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Deleting offline snapshot 3d947234-a03b-4484-bfaf-a380fda2bb6b of volume 3f57025c-6503-4903-a173-173a1b89e65c {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] snapshot_file for this snap is: volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[220551c9-efea-49c2-8500-b1db07aac5ea]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:30 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b Jul 23 03:32:30 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:30 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b" returned: 0 in 0.392s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f57025c-6503-4903-a173-173a1b89e65c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[54262622-4ea1-480d-b4b7-5ba2e74bc5e2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:30 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c Jul 23 03:32:30 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:31 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c" returned: 0 in 0.379s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:31 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b Jul 23 03:32:31 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:31 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b" returned: 0 in 0.389s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:31 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b Jul 23 03:32:31 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:31 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c.3d947234-a03b-4484-bfaf-a380fda2bb6b" returned: 0 in 0.243s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-3d947234-a03b-4484-bfaf-a380fda2bb6b" released by "_delete_snapshot" :: held 1.528s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-3f57025c-6503-4903-a173-173a1b89e65c" released by "delete_snapshot" :: held 1.559s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:31 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=118,cinder:UPDATE=158,cinder:INSERT=40,cinder:DELETE=15 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:32:31 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Created reservations ['2c538f09-c185-491b-9ff3-bc343b778d5e', '60a3fb97-27ee-4207-ac09-6e0a8e2ccfd4', '88e8b208-cd89-4c87-9cd0-37f96388d6d3', '2bd04db4-6d9d-4706-b9a4-8b4a9573a47c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:32 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Delete snapshot completed successfully. Jul 23 03:32:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c3efe61f-6306-48f1-a7e4-e6168ade4045 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-3d947234-a03b-4484-bfaf-a380fda2bb6b-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-3f57025c-6503-4903-a173-173a1b89e65c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-3f57025c-6503-4903-a173-173a1b89e65c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "cinder-quobyte-3f57025c-6503-4903-a173-173a1b89e65c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-3f57025c-6503-4903-a173-173a1b89e65c" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:32 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae08f4b-a946-461c-b73f-b921124f6ba6]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:32 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c Jul 23 03:32:32 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:32 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c" returned: 0 in 0.380s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:33 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c Jul 23 03:32:33 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:33 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3f57025c-6503-4903-a173-173a1b89e65c" returned: 0 in 0.253s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-quobyte-3f57025c-6503-4903-a173-173a1b89e65c" released by "delete_volume" :: held 0.696s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Created reservations ['a4562406-55f7-4e06-9738-b3eb38cfcc76', 'b65c823e-273f-468c-adc1-f77ac69df721', '8089379c-7c1f-4d14-a8d3-0b85a0ffc125', '7ec94a6f-b750-4c57-aa5d-6c236c1354d0'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:33 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:33 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:33 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.254s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:33 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Deleted volume successfully. Jul 23 03:32:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-766af953-1dac-4272-9fff-59f610f2c8a9 tempest-CreateVolumesFromSnapshotTest-641257769 None] Lock "cinder-3f57025c-6503-4903-a173-173a1b89e65c-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (fd74da1b-42ae-4399-9ead-c6cb437c2001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47bf04b-f2e8-46be-88e1-e7667ea2cacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47bf04b-f2e8-46be-88e1-e7667ea2cacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-130150722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03018b08-ba76-4453-b6b1-17519c1de84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:37Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c1d0ba-b68d-4f29-b737-587fec5a8a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c1d0ba-b68d-4f29-b737-587fec5a8a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edea66fb-b7df-4852-b3cd-b377b80e9a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edea66fb-b7df-4852-b3cd-b377b80e9a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03018b08-ba76-4453-b6b1-17519c1de84b', 'volume_name': 'volume-03018b08-ba76-4453-b6b1-17519c1de84b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94975bda-65cd-45b0-a4a7-ad242ab310fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94975bda-65cd-45b0-a4a7-ad242ab310fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a855cf-b3ea-4da5-af1d-96e265eacfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:36 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume 03018b08-ba76-4453-b6b1-17519c1de84b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03018b08-ba76-4453-b6b1-17519c1de84b', 'volume_size': 1} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-130150722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03018b08-ba76-4453-b6b1-17519c1de84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:37Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Creating volume 03018b08-ba76-4453-b6b1-17519c1de84b {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:36 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:36 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b 1073741824 Jul 23 03:32:36 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Flow 'volume_create_manager' (da3999aa-0396-46fd-9100-d50c7f195298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1716c879-e084-472b-bea8-82b31147ece3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1716c879-e084-472b-bea8-82b31147ece3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-863659331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1212f088-0fad-4061-9eed-13b8571e901c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd53667ce8814076bd5b87cd7362089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:37Z,use_quota=True,user_id='a7b5bdd64fec4acd992953202c2337ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fec15fb-4513-4707-b5ae-ae8e1af213e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fec15fb-4513-4707-b5ae-ae8e1af213e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b9cdfa-e9df-47d9-89e7-8a8242520123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b9cdfa-e9df-47d9-89e7-8a8242520123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1212f088-0fad-4061-9eed-13b8571e901c', 'volume_name': 'volume-1212f088-0fad-4061-9eed-13b8571e901c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c6e303-57bc-432b-a948-0a94a3797c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c6e303-57bc-432b-a948-0a94a3797c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83246346-beb1-4f4f-bc3b-cc5a2215a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Volume 1212f088-0fad-4061-9eed-13b8571e901c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1212f088-0fad-4061-9eed-13b8571e901c', 'volume_size': 1} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Flow 'volume_create_manager' (7393ec3b-29b8-40df-b9e5-ae36879fd17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00fa7678-6812-4e3f-baef-4ad422ff813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00fa7678-6812-4e3f-baef-4ad422ff813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-137115625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf13fd0-643c-4419-9343-bd9cf7e52420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd53667ce8814076bd5b87cd7362089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:37Z,use_quota=True,user_id='a7b5bdd64fec4acd992953202c2337ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f11798-0835-40e7-abba-7746d3f47d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f11798-0835-40e7-abba-7746d3f47d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb130945-8949-4eb4-bb21-a4dcec1350ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb130945-8949-4eb4-bb21-a4dcec1350ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf13fd0-643c-4419-9343-bd9cf7e52420', 'volume_name': 'volume-fdf13fd0-643c-4419-9343-bd9cf7e52420', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b22049-e83d-4cd0-8bda-a8d45282a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b22049-e83d-4cd0-8bda-a8d45282a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da9fe9a-46a4-4452-af47-ccd33110522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Volume fdf13fd0-643c-4419-9343-bd9cf7e52420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf13fd0-643c-4419-9343-bd9cf7e52420', 'volume_size': 1} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:37 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Flow 'volume_create_manager' (fd98cbfe-8d43-4730-8e5a-a9c0aea2a07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7750e7ea-8460-4f09-b74b-e859169a4c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b 1073741824" returned: 0 in 0.568s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7750e7ea-8460-4f09-b74b-e859169a4c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1152255016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83db27c1-7b8b-495d-9db8-a9100b410d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd53667ce8814076bd5b87cd7362089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:37Z,use_quota=True,user_id='a7b5bdd64fec4acd992953202c2337ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94703b1c-8fb0-414f-80b6-de24269d20bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94703b1c-8fb0-414f-80b6-de24269d20bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf804e2-c44b-42c1-a882-d65b624e4ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf804e2-c44b-42c1-a882-d65b624e4ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83db27c1-7b8b-495d-9db8-a9100b410d41', 'volume_name': 'volume-83db27c1-7b8b-495d-9db8-a9100b410d41', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90f69bb-55c5-40e2-9a88-94180dc37d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90f69bb-55c5-40e2-9a88-94180dc37d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d60958-69c3-484d-b4fd-2967015f04a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Volume 83db27c1-7b8b-495d-9db8-a9100b410d41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83db27c1-7b8b-495d-9db8-a9100b410d41', 'volume_size': 1} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:37 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b Jul 23 03:32:37 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Flow 'volume_create_manager' (001df10b-32b3-4d28-94d1-ca4dc5319d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:37 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279e3ea0-089c-49f7-ad8b-d961153db61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b" returned: 0 in 0.286s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-863659331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1212f088-0fad-4061-9eed-13b8571e901c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd53667ce8814076bd5b87cd7362089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:37Z,use_quota=True,user_id='a7b5bdd64fec4acd992953202c2337ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Creating volume 1212f088-0fad-4061-9eed-13b8571e901c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:37 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279e3ea0-089c-49f7-ad8b-d961153db61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-431951881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f437eb92-77bf-4174-8394-45e891e9cdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd53667ce8814076bd5b87cd7362089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:38Z,use_quota=True,user_id='a7b5bdd64fec4acd992953202c2337ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b368bbdd-f2da-416f-ba18-5a5741474f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c 1073741824 Jul 23 03:32:37 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b368bbdd-f2da-416f-ba18-5a5741474f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0869eaa-6866-4aa3-9128-29134fad2efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0869eaa-6866-4aa3-9128-29134fad2efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f437eb92-77bf-4174-8394-45e891e9cdcf', 'volume_name': 'volume-f437eb92-77bf-4174-8394-45e891e9cdcf', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec138ea-818d-4357-b65f-97b8eda62427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec138ea-818d-4357-b65f-97b8eda62427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc41cf71-aa84-41a0-acb9-89848c360d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Volume f437eb92-77bf-4174-8394-45e891e9cdcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f437eb92-77bf-4174-8394-45e891e9cdcf', 'volume_size': 1} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a855cf-b3ea-4da5-af1d-96e265eacfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03018b08-ba76-4453-b6b1-17519c1de84b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f207e2a-74fd-44d5-941c-85d6fd7907f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:37 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume volume-03018b08-ba76-4453-b6b1-17519c1de84b (03018b08-ba76-4453-b6b1-17519c1de84b): created successfully Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f207e2a-74fd-44d5-941c-85d6fd7907f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (fd74da1b-42ae-4399-9ead-c6cb437c2001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:37 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f4a0782d-f3d2-4fec-b7e9-951e2e4b6c2d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created volume successfully. Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Flow 'volume_create_manager' (da799cd9-4e7d-4e5f-86ad-5ae6fc362e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabe5818-9ac3-4a43-a8b1-6383f241f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabe5818-9ac3-4a43-a8b1-6383f241f847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1788131682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52cf182-2870-45f0-a981-cc05caa0f821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd53667ce8814076bd5b87cd7362089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:38Z,use_quota=True,user_id='a7b5bdd64fec4acd992953202c2337ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2100575e-84eb-42ac-ba90-5611c2aa3792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2100575e-84eb-42ac-ba90-5611c2aa3792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e92381-6910-4c51-b548-df1bb70acf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e92381-6910-4c51-b548-df1bb70acf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b52cf182-2870-45f0-a981-cc05caa0f821', 'volume_name': 'volume-b52cf182-2870-45f0-a981-cc05caa0f821', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30161970-9172-435a-8a32-1feb3636614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30161970-9172-435a-8a32-1feb3636614a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ead677a-c387-48e9-a209-464f5c48b2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:38 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Volume b52cf182-2870-45f0-a981-cc05caa0f821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b52cf182-2870-45f0-a981-cc05caa0f821', 'volume_size': 1} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:38 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c 1073741824" returned: 0 in 0.468s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:38 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c Jul 23 03:32:38 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:38 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c" returned: 0 in 0.235s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-137115625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf13fd0-643c-4419-9343-bd9cf7e52420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd53667ce8814076bd5b87cd7362089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:37Z,use_quota=True,user_id='a7b5bdd64fec4acd992953202c2337ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Creating volume fdf13fd0-643c-4419-9343-bd9cf7e52420 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:38 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:38 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420 1073741824 Jul 23 03:32:38 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83246346-beb1-4f4f-bc3b-cc5a2215a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1212f088-0fad-4061-9eed-13b8571e901c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be01b96-bf57-4683-9b94-19457cb876db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:38 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Volume volume-1212f088-0fad-4061-9eed-13b8571e901c (1212f088-0fad-4061-9eed-13b8571e901c): created successfully Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be01b96-bf57-4683-9b94-19457cb876db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Flow 'volume_create_manager' (da3999aa-0396-46fd-9100-d50c7f195298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:38 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5b5b98bd-c435-4c81-9757-1f3f2d652926 tempest-CreateVolumesFromImageTest-370038084 None] Created volume successfully. Jul 23 03:32:39 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420 1073741824" returned: 0 in 0.442s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:39 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420 Jul 23 03:32:39 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (602208c7-1eeb-45bf-8e15-aa938688cc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22efb1e7-9b48-496e-881b-36acc69edd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22efb1e7-9b48-496e-881b-36acc69edd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205713389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5baec9b3-c4b2-4185-838a-db4124c13cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:39Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5ffcb7-1b8a-46ba-aad5-23f79a61ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5ffcb7-1b8a-46ba-aad5-23f79a61ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fa467b-a407-4c2b-b176-55817bae408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fa467b-a407-4c2b-b176-55817bae408f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5baec9b3-c4b2-4185-838a-db4124c13cf7', 'volume_name': 'volume-5baec9b3-c4b2-4185-838a-db4124c13cf7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bb4cd0-1bdb-49ba-8a9e-e51728638848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bb4cd0-1bdb-49ba-8a9e-e51728638848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:39 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced64385-b624-432c-ac60-e605d7e00679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume 5baec9b3-c4b2-4185-838a-db4124c13cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5baec9b3-c4b2-4185-838a-db4124c13cf7', 'volume_size': 1} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420" returned: 0 in 0.291s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.863s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1152255016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83db27c1-7b8b-495d-9db8-a9100b410d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd53667ce8814076bd5b87cd7362089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:37Z,use_quota=True,user_id='a7b5bdd64fec4acd992953202c2337ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Creating volume 83db27c1-7b8b-495d-9db8-a9100b410d41 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:39 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da9fe9a-46a4-4452-af47-ccd33110522f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf13fd0-643c-4419-9343-bd9cf7e52420', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:39 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41 1073741824 Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6053249c-ba25-4f1d-9c78-4aed6087e40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:39 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Volume volume-fdf13fd0-643c-4419-9343-bd9cf7e52420 (fdf13fd0-643c-4419-9343-bd9cf7e52420): created successfully Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6053249c-ba25-4f1d-9c78-4aed6087e40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Flow 'volume_create_manager' (7393ec3b-29b8-40df-b9e5-ae36879fd17b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a186df96-cfbb-49d0-b138-13afb7371c21 tempest-CreateVolumesFromImageTest-370038084 None] Created volume successfully. Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (a84b4234-6842-41fe-af79-c16f457e4967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8194e2-0dae-4adf-8978-0bc5b93e6add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8194e2-0dae-4adf-8978-0bc5b93e6add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-747397462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80466705-596b-41f2-b9b3-6671909bbeba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:40Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65dddba9-26e0-4ca9-88ef-048dc02b5908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65dddba9-26e0-4ca9-88ef-048dc02b5908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aa3bb0-8a6d-4d1a-8c40-59e644e4ed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aa3bb0-8a6d-4d1a-8c40-59e644e4ed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80466705-596b-41f2-b9b3-6671909bbeba', 'volume_name': 'volume-80466705-596b-41f2-b9b3-6671909bbeba', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aed1bea-3eb7-47a5-8482-c8fea75997c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aed1bea-3eb7-47a5-8482-c8fea75997c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058aa880-80b7-4e4e-ad20-f1df4387b1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume 80466705-596b-41f2-b9b3-6671909bbeba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80466705-596b-41f2-b9b3-6671909bbeba', 'volume_size': 1} Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:39 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41 1073741824" returned: 0 in 0.554s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (5fda47a1-238a-48bf-a022-552004ffd46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c192e8a1-e988-461a-bf12-f9bbaff7f81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c192e8a1-e988-461a-bf12-f9bbaff7f81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827624817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f447a21b-4ce7-40e2-aa76-a7e5e9b15a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:40Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41 Jul 23 03:32:40 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a859913f-4355-43e8-868a-48c18e08031a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a859913f-4355-43e8-868a-48c18e08031a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b675ebbe-eb61-41a6-9553-15d011d6efaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b675ebbe-eb61-41a6-9553-15d011d6efaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f447a21b-4ce7-40e2-aa76-a7e5e9b15a17', 'volume_name': 'volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1469e5ac-5b50-4298-8a9f-ed181b404754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1469e5ac-5b50-4298-8a9f-ed181b404754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14ce046-32db-450a-bfae-1e92f97c5688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume f447a21b-4ce7-40e2-aa76-a7e5e9b15a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17', 'volume_size': 1} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:40 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41" returned: 0 in 0.321s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.462s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-431951881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f437eb92-77bf-4174-8394-45e891e9cdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd53667ce8814076bd5b87cd7362089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:38Z,use_quota=True,user_id='a7b5bdd64fec4acd992953202c2337ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Creating volume f437eb92-77bf-4174-8394-45e891e9cdcf {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:40 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d60958-69c3-484d-b4fd-2967015f04a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83db27c1-7b8b-495d-9db8-a9100b410d41', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf 1073741824 Jul 23 03:32:40 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f610dd-b5e0-45a6-92c9-ceffab8e70d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Volume volume-83db27c1-7b8b-495d-9db8-a9100b410d41 (83db27c1-7b8b-495d-9db8-a9100b410d41): created successfully Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f610dd-b5e0-45a6-92c9-ceffab8e70d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Flow 'volume_create_manager' (fd98cbfe-8d43-4730-8e5a-a9c0aea2a07e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (97a7303e-0d17-42e7-99dc-eb16076df77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cc215f-5e40-4759-90b3-5af71be04d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9a9fa54b-f83a-448a-b50a-ac843ac66381 tempest-CreateVolumesFromImageTest-370038084 None] Created volume successfully. Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cc215f-5e40-4759-90b3-5af71be04d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1007062138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bbb514-7fab-4410-b29b-008370ae2bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:40Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0b0e67-0c55-4379-b5a6-650579a0f027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0b0e67-0c55-4379-b5a6-650579a0f027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a598afc-5a22-4fac-9860-437951546f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a598afc-5a22-4fac-9860-437951546f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88bbb514-7fab-4410-b29b-008370ae2bc6', 'volume_name': 'volume-88bbb514-7fab-4410-b29b-008370ae2bc6', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cb48fe-fb31-469c-ba5a-f148d1a614b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cb48fe-fb31-469c-ba5a-f148d1a614b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22c2bca-9abd-413a-a654-d6573fcba547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume 88bbb514-7fab-4410-b29b-008370ae2bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88bbb514-7fab-4410-b29b-008370ae2bc6', 'volume_size': 1} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (8c54d993-6bc8-402d-9399-ed2601531e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c85966e-b5bd-406e-bb85-486db8aa70f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c85966e-b5bd-406e-bb85-486db8aa70f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1136527624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101c57a4-9945-42ab-949b-835647989145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:41Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788a83e8-8d91-4df7-a098-849377b56236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788a83e8-8d91-4df7-a098-849377b56236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6643ce-630a-4ccf-bb02-d2c1452ac672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6643ce-630a-4ccf-bb02-d2c1452ac672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101c57a4-9945-42ab-949b-835647989145', 'volume_name': 'volume-101c57a4-9945-42ab-949b-835647989145', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6e1107-7d1f-4769-a5b2-7e29f146ab40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6e1107-7d1f-4769-a5b2-7e29f146ab40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e559303c-68ca-4332-9a44-654ba61679a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume 101c57a4-9945-42ab-949b-835647989145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101c57a4-9945-42ab-949b-835647989145', 'volume_size': 1} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf 1073741824" returned: 0 in 0.561s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:41 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf Jul 23 03:32:41 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:41 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf" returned: 0 in 0.244s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1788131682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52cf182-2870-45f0-a981-cc05caa0f821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd53667ce8814076bd5b87cd7362089d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:38Z,use_quota=True,user_id='a7b5bdd64fec4acd992953202c2337ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Creating volume b52cf182-2870-45f0-a981-cc05caa0f821 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:41 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc41cf71-aa84-41a0-acb9-89848c360d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f437eb92-77bf-4174-8394-45e891e9cdcf', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:41 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821 1073741824 Jul 23 03:32:41 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddbfe44-f475-462d-aa31-2ce30ff72ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:41 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Volume volume-f437eb92-77bf-4174-8394-45e891e9cdcf (f437eb92-77bf-4174-8394-45e891e9cdcf): created successfully Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddbfe44-f475-462d-aa31-2ce30ff72ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Flow 'volume_create_manager' (001df10b-32b3-4d28-94d1-ca4dc5319d56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:41 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e216226d-f237-46cd-80f3-3f6eeb133900 tempest-CreateVolumesFromImageTest-370038084 None] Created volume successfully. Jul 23 03:32:41 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821 1073741824" returned: 0 in 0.452s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:41 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821 Jul 23 03:32:41 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:41 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821" returned: 0 in 0.243s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.580s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205713389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5baec9b3-c4b2-4185-838a-db4124c13cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:39Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Creating volume 5baec9b3-c4b2-4185-838a-db4124c13cf7 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:41 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ead677a-c387-48e9-a209-464f5c48b2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52cf182-2870-45f0-a981-cc05caa0f821', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:42 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7 1073741824 Jul 23 03:32:42 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c47558-803e-47f6-9593-7dae78a8409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:42 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Volume volume-b52cf182-2870-45f0-a981-cc05caa0f821 (b52cf182-2870-45f0-a981-cc05caa0f821): created successfully Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c47558-803e-47f6-9593-7dae78a8409a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Flow 'volume_create_manager' (da799cd9-4e7d-4e5f-86ad-5ae6fc362e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-04b49194-e06c-4add-a7e5-9d87f1c6c726 tempest-CreateVolumesFromImageTest-370038084 None] Created volume successfully. Jul 23 03:32:42 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7 1073741824" returned: 0 in 0.420s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:42 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7 Jul 23 03:32:42 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:42 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7" returned: 0 in 0.275s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.928s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-747397462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80466705-596b-41f2-b9b3-6671909bbeba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:40Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Creating volume 80466705-596b-41f2-b9b3-6671909bbeba {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:42 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "cinder-b52cf182-2870-45f0-a981-cc05caa0f821-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:42 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba 1073741824 Jul 23 03:32:42 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced64385-b624-432c-ac60-e605d7e00679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5baec9b3-c4b2-4185-838a-db4124c13cf7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8256b15e-0d1c-4797-81db-81ec89a6593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-b52cf182-2870-45f0-a981-cc05caa0f821-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:42 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume volume-5baec9b3-c4b2-4185-838a-db4124c13cf7 (5baec9b3-c4b2-4185-838a-db4124c13cf7): created successfully Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8256b15e-0d1c-4797-81db-81ec89a6593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (602208c7-1eeb-45bf-8e15-aa938688cc7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "cinder-quobyte-b52cf182-2870-45f0-a981-cc05caa0f821" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-880acd84-d4a4-4926-bf3d-8eb5c0799142 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created volume successfully. Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-quobyte-b52cf182-2870-45f0-a981-cc05caa0f821" acquired by "delete_volume" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c405c-05c0-4cee-84a0-0044740f9202]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:43 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821 Jul 23 03:32:43 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:43 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba 1073741824" returned: 0 in 0.507s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:43 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821" returned: 0 in 0.402s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:43 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba Jul 23 03:32:43 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:43 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821 Jul 23 03:32:43 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:43 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba" returned: 0 in 0.276s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:43 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.443s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827624817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f447a21b-4ce7-40e2-aa76-a7e5e9b15a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:40Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Creating volume f447a21b-4ce7-40e2-aa76-a7e5e9b15a17 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:43 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b52cf182-2870-45f0-a981-cc05caa0f821" returned: 0 in 0.278s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:43 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17 1073741824 Jul 23 03:32:43 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-quobyte-b52cf182-2870-45f0-a981-cc05caa0f821" released by "delete_volume" :: held 0.724s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058aa880-80b7-4e4e-ad20-f1df4387b1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80466705-596b-41f2-b9b3-6671909bbeba', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff757a3-9c07-427f-a932-98d8e2321569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:43 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume volume-80466705-596b-41f2-b9b3-6671909bbeba (80466705-596b-41f2-b9b3-6671909bbeba): created successfully Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff757a3-9c07-427f-a932-98d8e2321569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (a84b4234-6842-41fe-af79-c16f457e4967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:43 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-106106ed-e11d-4355-b9ba-570e381d6681 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created volume successfully. Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Created reservations ['14c02b95-9272-4df6-83f7-216f87d3d924', '37cc3927-bae1-4e7f-b2f9-0532eb7b5298', '2d02b53e-372b-40e7-b822-4d0c033807a3', '0d3bed9f-ad51-48b6-a444-04a47f461a94'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:43 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:43 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "cinder-f437eb92-77bf-4174-8394-45e891e9cdcf-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-f437eb92-77bf-4174-8394-45e891e9cdcf-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:44 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.278s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "cinder-quobyte-f437eb92-77bf-4174-8394-45e891e9cdcf" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Deleted volume successfully. Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a548e5b-087c-4570-a259-ddb2c8a3e6e2 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-b52cf182-2870-45f0-a981-cc05caa0f821-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-quobyte-f437eb92-77bf-4174-8394-45e891e9cdcf" acquired by "delete_volume" :: waited 0.032s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:44 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17 1073741824" returned: 0 in 0.527s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0182a55b-5924-4e45-8b47-af248064c225]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:44 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17 Jul 23 03:32:44 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:44 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf Jul 23 03:32:44 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:44 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17" returned: 0 in 0.254s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.813s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1007062138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bbb514-7fab-4410-b29b-008370ae2bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:40Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Creating volume 88bbb514-7fab-4410-b29b-008370ae2bc6 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:44 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14ce046-32db-450a-bfae-1e92f97c5688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:44 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6 1073741824 Jul 23 03:32:44 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efdc435-f6f9-4734-b4de-1baf82a0e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:44 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17 (f447a21b-4ce7-40e2-aa76-a7e5e9b15a17): created successfully Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efdc435-f6f9-4734-b4de-1baf82a0e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (5fda47a1-238a-48bf-a022-552004ffd46a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-77986d7f-f538-47fc-a592-eb7015347d37 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created volume successfully. Jul 23 03:32:44 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf" returned: 0 in 0.374s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:44 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf Jul 23 03:32:44 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:44 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f437eb92-77bf-4174-8394-45e891e9cdcf" returned: 0 in 0.251s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-quobyte-f437eb92-77bf-4174-8394-45e891e9cdcf" released by "delete_volume" :: held 0.674s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Created reservations ['eb2bd291-b9c4-4f7d-a338-ae4860e13b2a', 'bc6a6752-b0ed-4aa8-8b0f-a1a0972ed7fc', '306c109e-2eed-4e8f-94fa-8250bd079a4a', 'e7ba0d54-846b-438c-a7df-97345cce1d96'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:44 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6 1073741824" returned: 0 in 0.460s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:44 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:44 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:44 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6 Jul 23 03:32:44 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:45 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "cinder-83db27c1-7b8b-495d-9db8-a9100b410d41-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.263s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Deleted volume successfully. Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-83db27c1-7b8b-495d-9db8-a9100b410d41-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:45 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6" returned: 0 in 0.312s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cc982561-1969-48bd-ba47-c03ac21e4905 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-f437eb92-77bf-4174-8394-45e891e9cdcf-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.256s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1136527624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101c57a4-9945-42ab-949b-835647989145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b77bbd0aeb946cbaccc947e3b3ccddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:41Z,use_quota=True,user_id='f8ca0096996f4ad2a91b5f7b5f7ca110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Creating volume 101c57a4-9945-42ab-949b-835647989145 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:45 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:45 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145 1073741824 Jul 23 03:32:45 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22c2bca-9abd-413a-a654-d6573fcba547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88bbb514-7fab-4410-b29b-008370ae2bc6', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606d77bc-b477-43df-a365-4c5af81367dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "cinder-quobyte-83db27c1-7b8b-495d-9db8-a9100b410d41" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:45 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume volume-88bbb514-7fab-4410-b29b-008370ae2bc6 (88bbb514-7fab-4410-b29b-008370ae2bc6): created successfully Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606d77bc-b477-43df-a365-4c5af81367dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (97a7303e-0d17-42e7-99dc-eb16076df77e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-quobyte-83db27c1-7b8b-495d-9db8-a9100b410d41" acquired by "delete_volume" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7d98dc6d-04ca-41ba-a34d-dc4458e127e7 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created volume successfully. Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ac760e-f2d6-40f3-a697-b87fea9219f2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:45 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41 Jul 23 03:32:45 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:45 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145 1073741824" returned: 0 in 0.457s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:45 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41" returned: 0 in 0.365s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:45 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41 Jul 23 03:32:45 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:45 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145 Jul 23 03:32:45 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:45 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-83db27c1-7b8b-495d-9db8-a9100b410d41" returned: 0 in 0.246s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-quobyte-83db27c1-7b8b-495d-9db8-a9100b410d41" released by "delete_volume" :: held 0.657s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:45 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145" returned: 0 in 0.252s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e559303c-68ca-4332-9a44-654ba61679a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101c57a4-9945-42ab-949b-835647989145', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c5c4e1-2102-4583-84c6-cebb9f54d459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:46 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Volume volume-101c57a4-9945-42ab-949b-835647989145 (101c57a4-9945-42ab-949b-835647989145): created successfully Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c5c4e1-2102-4583-84c6-cebb9f54d459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Flow 'volume_create_manager' (8c54d993-6bc8-402d-9399-ed2601531e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d8a536cd-587e-460d-9dfc-a2275a47d43f tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created volume successfully. Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Created reservations ['3ee48566-cd1b-4db7-9eb3-3d34854c66b7', 'd6b7bfc6-c82f-428f-a4b6-88157b4c599e', '68ff98b5-edfc-494c-ad6c-11ac9c7b7595', 'f1fc1631-ea8b-423c-aad6-ec0e7b367f8d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:46 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:46 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "cinder-fdf13fd0-643c-4419-9343-bd9cf7e52420-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-fdf13fd0-643c-4419-9343-bd9cf7e52420-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "cinder-quobyte-fdf13fd0-643c-4419-9343-bd9cf7e52420" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-quobyte-fdf13fd0-643c-4419-9343-bd9cf7e52420" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:46 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.255s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab46d2c9-a15e-41ee-aa1e-3b04b9a4a119]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Deleted volume successfully. Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3e058a18-529f-4184-986a-07d5cf42e5e0 tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-83db27c1-7b8b-495d-9db8-a9100b410d41-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-101c57a4-9945-42ab-949b-835647989145-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-101c57a4-9945-42ab-949b-835647989145-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:46 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420 Jul 23 03:32:46 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-quobyte-101c57a4-9945-42ab-949b-835647989145" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-101c57a4-9945-42ab-949b-835647989145" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9da7ee5-083c-4ddb-8b6f-ec91ff2c7737]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:46 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145 Jul 23 03:32:46 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:46 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420" returned: 0 in 0.371s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:46 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420 Jul 23 03:32:46 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:46 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145" returned: 0 in 0.370s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:46 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145 Jul 23 03:32:46 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:47 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-fdf13fd0-643c-4419-9343-bd9cf7e52420" returned: 0 in 0.243s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-quobyte-fdf13fd0-643c-4419-9343-bd9cf7e52420" released by "delete_volume" :: held 0.665s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Created reservations ['4b9c7cea-0b34-4df5-aae4-3db100244e36', '57467dae-fddc-4e47-b621-33ffc7ab87bd', 'b7e34e13-008b-4815-8948-0446c64e47e3', 'e484beaf-aec1-4472-971f-a3b81b5e733d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:47 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:47 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:47 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-101c57a4-9945-42ab-949b-835647989145" returned: 0 in 0.283s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-101c57a4-9945-42ab-949b-835647989145" released by "delete_volume" :: held 0.693s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created reservations ['6568468f-351f-411f-8d88-0de6bc512597', 'dbd172d4-2fbf-4c8d-b166-39d6df651a2e', '2daf9ad7-68b3-490b-bec3-bf69f60ef007', '481ed372-de52-4b50-897f-117f20677c1f'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:47 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.303s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Deleted volume successfully. Jul 23 03:32:47 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:47 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "cinder-1212f088-0fad-4061-9eed-13b8571e901c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c68a0676-6233-49da-9e2b-540c62bf55ee tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-fdf13fd0-643c-4419-9343-bd9cf7e52420-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-1212f088-0fad-4061-9eed-13b8571e901c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "cinder-quobyte-1212f088-0fad-4061-9eed-13b8571e901c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-quobyte-1212f088-0fad-4061-9eed-13b8571e901c" acquired by "delete_volume" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef7c724-80eb-487f-8673-b2c3780d5b17]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-88bbb514-7fab-4410-b29b-008370ae2bc6-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-88bbb514-7fab-4410-b29b-008370ae2bc6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-quobyte-88bbb514-7fab-4410-b29b-008370ae2bc6" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:47 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.314s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Deleted volume successfully. Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-88bbb514-7fab-4410-b29b-008370ae2bc6" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:47 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c Jul 23 03:32:47 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bd3e46e7-a36b-4b6b-a6c8-2a8331d9b48e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-101c57a4-9945-42ab-949b-835647989145-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a2a7b0-5582-4ed4-ad96-89b16031e62b]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:47 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6 Jul 23 03:32:47 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:48 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c" returned: 0 in 0.408s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:48 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c Jul 23 03:32:48 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:48 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6" returned: 0 in 0.363s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:48 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6 Jul 23 03:32:48 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:48 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1212f088-0fad-4061-9eed-13b8571e901c" returned: 0 in 0.250s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-quobyte-1212f088-0fad-4061-9eed-13b8571e901c" released by "delete_volume" :: held 0.707s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Created reservations ['4ff052f8-9162-4781-9bb5-783f3c928ade', 'aeaae0b3-ac33-4908-86a8-d31a9bee16e8', 'fa01a64c-d592-4378-ad78-72876fd885ac', '3be9cf6b-2516-491c-87b5-1ae5529e469e'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:48 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-88bbb514-7fab-4410-b29b-008370ae2bc6" returned: 0 in 0.264s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-88bbb514-7fab-4410-b29b-008370ae2bc6" released by "delete_volume" :: held 0.674s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:48 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:48 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created reservations ['8c1e544c-86b8-4bc4-86ca-228fb7ca5291', '64b69c75-6de5-4d77-9ff2-a1eb510f37c3', '386d9993-d9bb-42c3-ad71-dcee4d88c4e7', 'f053db41-59c7-4b19-b3d4-21726c59512c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:48 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:48 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:48 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.265s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:48 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Deleted volume successfully. Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c0c16c-3543-4979-8110-9844dd6df84e tempest-CreateVolumesFromImageTest-370038084 None] Lock "cinder-1212f088-0fad-4061-9eed-13b8571e901c-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:48 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.278s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:48 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Deleted volume successfully. Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4f63b01c-f920-4784-a949-4f49752b4862 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-88bbb514-7fab-4410-b29b-008370ae2bc6-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-quobyte-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1ae98f-1df3-425c-8f08-8c9e18c4a666]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:49 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17 Jul 23 03:32:49 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:49 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17" returned: 0 in 0.375s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:49 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17 Jul 23 03:32:49 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:49 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17" returned: 0 in 0.263s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17" released by "delete_volume" :: held 0.690s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:49 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created reservations ['ccc33021-f75c-4f0d-93a2-6845909a5f39', '07040b0b-ce4d-4a92-b711-0e67a411df47', '15858da4-150b-43d1-ae8a-c7971ce26c8b', '6f37ce06-39aa-4832-8f57-e1edcf527d04'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:49 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:49 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-80466705-596b-41f2-b9b3-6671909bbeba-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-80466705-596b-41f2-b9b3-6671909bbeba-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:50 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.298s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:50 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Deleted volume successfully. Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-quobyte-80466705-596b-41f2-b9b3-6671909bbeba" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f3c323f5-1d13-407f-9a15-07500f82fd3d tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-f447a21b-4ce7-40e2-aa76-a7e5e9b15a17-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-80466705-596b-41f2-b9b3-6671909bbeba" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c22e6e2-3652-4f80-b4c0-b05b765a89e4]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:50 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba Jul 23 03:32:50 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:50 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba" returned: 0 in 0.365s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:50 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba Jul 23 03:32:50 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:50 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-80466705-596b-41f2-b9b3-6671909bbeba" returned: 0 in 0.248s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-80466705-596b-41f2-b9b3-6671909bbeba" released by "delete_volume" :: held 0.660s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created reservations ['14dc088f-6665-4a1a-a57a-87b2219d6657', 'c47b2487-c87a-4fad-87ab-1e67b9b89865', '426c700e-0329-4ec8-ba40-c2ff5bb9fe6d', '5d8e7c0a-ba82-4ae7-918f-b6d3b837f8cf'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:50 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:50 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:51 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.255s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:51 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Deleted volume successfully. Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c251ab5a-82db-4d8e-a205-7f1ae0ab3b78 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-80466705-596b-41f2-b9b3-6671909bbeba-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-5baec9b3-c4b2-4185-838a-db4124c13cf7-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-5baec9b3-c4b2-4185-838a-db4124c13cf7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-quobyte-5baec9b3-c4b2-4185-838a-db4124c13cf7" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-5baec9b3-c4b2-4185-838a-db4124c13cf7" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[645f912d-7f54-40fe-bf37-27eec11f8f86]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:51 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7 Jul 23 03:32:51 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Flow 'volume_create_manager' (2fb31002-ee8a-4acf-8bbd-da4fb4f4310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa2d203-c230-4456-844e-8d243768654c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa2d203-c230-4456-844e-8d243768654c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-483630307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51db6683-d1e3-44ea-9225-b73d5bba57d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc041986f944587bc69df50ab1704c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:52Z,use_quota=True,user_id='8844644711bb48e19e0fb173cd968c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:51 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d303c1cf-62d0-4480-9459-d4bd5088bf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d303c1cf-62d0-4480-9459-d4bd5088bf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cb457c-b4d3-4ffd-996c-fe8bfef8abc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cb457c-b4d3-4ffd-996c-fe8bfef8abc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51db6683-d1e3-44ea-9225-b73d5bba57d3', 'volume_name': 'volume-51db6683-d1e3-44ea-9225-b73d5bba57d3', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b97d98e-693c-401b-8782-6010d81e1cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b97d98e-693c-401b-8782-6010d81e1cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fa1569-e503-4f10-9cb2-38e5e1c074fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:51 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Volume 51db6683-d1e3-44ea-9225-b73d5bba57d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51db6683-d1e3-44ea-9225-b73d5bba57d3', 'volume_size': 1} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-483630307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51db6683-d1e3-44ea-9225-b73d5bba57d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc041986f944587bc69df50ab1704c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:52Z,use_quota=True,user_id='8844644711bb48e19e0fb173cd968c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Creating volume 51db6683-d1e3-44ea-9225-b73d5bba57d3 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:51 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7" returned: 0 in 0.438s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:51 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 1073741824 Jul 23 03:32:51 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:51 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7 Jul 23 03:32:51 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:52 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-5baec9b3-c4b2-4185-838a-db4124c13cf7" returned: 0 in 0.251s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-5baec9b3-c4b2-4185-838a-db4124c13cf7" released by "delete_volume" :: held 0.731s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created reservations ['7a5abbf4-1218-40ec-8cfd-86ca3ce49602', '1b2a8767-6772-42cc-8e9f-934d2aa01095', '3578cb1a-84f9-4816-a8d8-3c565f8107b5', 'ef0c102a-eb33-47cf-8122-50e797bf4cf6'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:52 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:52 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:52 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 1073741824" returned: 0 in 0.504s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:52 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 Jul 23 03:32:52 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-03018b08-ba76-4453-b6b1-17519c1de84b-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-03018b08-ba76-4453-b6b1-17519c1de84b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "cinder-quobyte-03018b08-ba76-4453-b6b1-17519c1de84b" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:52 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.269s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:52 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Deleted volume successfully. Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-03018b08-ba76-4453-b6b1-17519c1de84b" acquired by "delete_volume" :: waited 0.035s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c96596ba-e440-4dce-a5e3-ef5a310c1e4e tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-5baec9b3-c4b2-4185-838a-db4124c13cf7-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fee60a1-022e-4062-a7df-254c92d0949d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:52 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3" returned: 0 in 0.273s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fa1569-e503-4f10-9cb2-38e5e1c074fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51db6683-d1e3-44ea-9225-b73d5bba57d3', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a69a725-7cfe-401e-88f7-1964f738ef7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:52 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Volume volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 (51db6683-d1e3-44ea-9225-b73d5bba57d3): created successfully Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a69a725-7cfe-401e-88f7-1964f738ef7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:52 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b Jul 23 03:32:52 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Flow 'volume_create_manager' (2fb31002-ee8a-4acf-8bbd-da4fb4f4310c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:52 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-29331797-96d9-42a1-9a31-b83eeef0f94a tempest-VolumeDependencyTests-274990024 None] Created volume successfully. Jul 23 03:32:52 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b" returned: 0 in 0.349s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:52 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b Jul 23 03:32:52 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:53 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-03018b08-ba76-4453-b6b1-17519c1de84b" returned: 0 in 0.227s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-quobyte-03018b08-ba76-4453-b6b1-17519c1de84b" released by "delete_volume" :: held 0.617s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Created reservations ['acb5e385-942e-48db-913b-d40bcbfd649d', 'aafe2c48-4a7c-4b73-a75b-7860ae4675e7', '7427ad51-e208-4b15-9d61-8598c73981c1', '7cef5b97-0317-4337-8298-188940b6a86c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:53 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:32:53 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:53 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.236s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:32:53 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Deleted volume successfully. Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-88376eed-aa16-4e15-8193-1101935d64d9 tempest-CreateVolumesFromSourceVolumeTest-96927590 None] Lock "cinder-03018b08-ba76-4453-b6b1-17519c1de84b-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] Creating offline snapshot a88f73bf-170a-4ea1-b492-2e755cf61b66 of volume 51db6683-d1e3-44ea-9225-b73d5bba57d3 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:32:54 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[35763ec7-6af4-4d73-86e5-2ed5bca6c26e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:54 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 Jul 23 03:32:54 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:54 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3" returned: 0 in 0.385s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:54 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 1G Jul 23 03:32:54 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:54 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 1G" returned: 0 in 0.435s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:54 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 Jul 23 03:32:54 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:55 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66" returned: 0 in 0.294s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:55 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 is being set with open permissions: ugo+rw Jul 23 03:32:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:55 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 Jul 23 03:32:55 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:55 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66" returned: 0 in 0.233s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:55 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.info Jul 23 03:32:55 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:55 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.info" returned: 0 in 0.250s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:55 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.info is being set with open permissions: ugo+rw Jul 23 03:32:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:55 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.info Jul 23 03:32:55 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:55 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.info" returned: 0 in 0.238s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:55 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2970dae0-fbc2-4a1a-81d3-f312120f8412 tempest-VolumeDependencyTests-274990024 None] Create snapshot completed successfully Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Flow 'volume_create_manager' (76e6190e-b74d-4f1d-a2e2-0bbf5f621893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc73203-0b94-444f-bbaa-3c86269f8724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc73203-0b94-444f-bbaa-3c86269f8724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-844965669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa7f305-97c9-4a29-b1b7-494c1ff40401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fc041986f944587bc69df50ab1704c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a88f73bf-170a-4ea1-b492-2e755cf61b66,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:32:57Z,use_quota=True,user_id='8844644711bb48e19e0fb173cd968c52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9faba6c-ee90-43d4-8f76-75e8a181bd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9faba6c-ee90-43d4-8f76-75e8a181bd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe115c12-488d-4fa3-9b70-63ab68a589c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe115c12-488d-4fa3-9b70-63ab68a589c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7fa7f305-97c9-4a29-b1b7-494c1ff40401', 'volume_name': 'volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401', 'volume_size': 1, 'snapshot_id': 'a88f73bf-170a-4ea1-b492-2e755cf61b66'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d3d37c-f110-4839-9262-112781495a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d3d37c-f110-4839-9262-112781495a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39203d37-29d4-4912-8b14-7f7b20dd2ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:32:56 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Volume 7fa7f305-97c9-4a29-b1b7-494c1ff40401: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401', 'volume_size': 1, 'snapshot_id': 'a88f73bf-170a-4ea1-b492-2e755cf61b66'} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Acquiring lock "cinder-quobyte-a88f73bf-170a-4ea1-b492-2e755cf61b66-7fa7f305-97c9-4a29-b1b7-494c1ff40401" by "_create_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-a88f73bf-170a-4ea1-b492-2e755cf61b66-7fa7f305-97c9-4a29-b1b7-494c1ff40401" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Creating volume 7fa7f305-97c9-4a29-b1b7-494c1ff40401 from snapshot a88f73bf-170a-4ea1-b492-2e755cf61b66 {{(pid=88392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Acquiring lock "cinder-quobyte-7fa7f305-97c9-4a29-b1b7-494c1ff40401" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-7fa7f305-97c9-4a29-b1b7-494c1ff40401" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] snapshot: a88f73bf-170a-4ea1-b492-2e755cf61b66, volume: 7fa7f305-97c9-4a29-b1b7-494c1ff40401, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e4e130-efbe-4efd-826b-6b5aa56f6306]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:56 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 Jul 23 03:32:56 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:57 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66" returned: 0 in 0.375s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51db6683-d1e3-44ea-9225-b73d5bba57d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:32:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:32:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:32:57 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36ace9f-a6d4-4e5d-b8bb-f7c94cd15187]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:32:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:57 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 Jul 23 03:32:57 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:32:57 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 23 03:32:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3" returned: 0 in 0.388s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:32:57 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:32:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:32:57 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 Jul 23 03:32:57 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:02 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401" returned: 0 in 4.551s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ea8df3-e0ff-4744-9959-9ebbf37e54e4]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:02 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 Jul 23 03:33:02 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:02 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3" returned: 0 in 0.512s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:33:02 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Converted 1024.00 MB image at 224.96 MB/s Jul 23 03:33:02 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 is being set with open permissions: ugo+rw Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:02 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 Jul 23 03:33:02 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:02 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401" returned: 0 in 0.245s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-7fa7f305-97c9-4a29-b1b7-494c1ff40401" released by "_copy_volume_from_snapshot" :: held 6.172s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-a88f73bf-170a-4ea1-b492-2e755cf61b66-7fa7f305-97c9-4a29-b1b7-494c1ff40401" released by "_create_volume_from_snapshot" :: held 6.204s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.223s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39203d37-29d4-4912-8b14-7f7b20dd2ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401', 'volume_size': 1, 'snapshot_id': 'a88f73bf-170a-4ea1-b492-2e755cf61b66'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7afa99a-fe61-46f4-bc4c-2e2ac4329474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:03 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Volume volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 (7fa7f305-97c9-4a29-b1b7-494c1ff40401): created successfully Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7afa99a-fe61-46f4-bc4c-2e2ac4329474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Flow 'volume_create_manager' (76e6190e-b74d-4f1d-a2e2-0bbf5f621893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:03 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9e3004e3-1eae-4184-a007-4d5253e197aa tempest-VolumeDependencyTests-274990024 None] Created volume successfully. Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Acquiring lock "cinder-a88f73bf-170a-4ea1-b492-2e755cf61b66-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Lock "cinder-a88f73bf-170a-4ea1-b492-2e755cf61b66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Acquiring lock "cinder-quobyte-51db6683-d1e3-44ea-9225-b73d5bba57d3" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-51db6683-d1e3-44ea-9225-b73d5bba57d3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Acquiring lock "cinder-quobyte-a88f73bf-170a-4ea1-b492-2e755cf61b66" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-a88f73bf-170a-4ea1-b492-2e755cf61b66" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Deleting offline snapshot a88f73bf-170a-4ea1-b492-2e755cf61b66 of volume 51db6683-d1e3-44ea-9225-b73d5bba57d3 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] snapshot_file for this snap is: volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[26116fc1-6f7c-46a8-9a5f-0c2ce0f71c7e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:03 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 Jul 23 03:33:03 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:03 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66" returned: 0 in 0.382s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51db6683-d1e3-44ea-9225-b73d5bba57d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e725e6-3f25-4b3b-8983-2389a09f5c21]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:03 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 Jul 23 03:33:03 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:04 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3" returned: 0 in 0.353s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:04 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 Jul 23 03:33:04 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:04 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66" returned: 0 in 0.338s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:04 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66 Jul 23 03:33:04 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:04 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3.a88f73bf-170a-4ea1-b492-2e755cf61b66" returned: 0 in 0.231s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-a88f73bf-170a-4ea1-b492-2e755cf61b66" released by "_delete_snapshot" :: held 1.428s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-51db6683-d1e3-44ea-9225-b73d5bba57d3" released by "delete_snapshot" :: held 1.455s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:04 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Created reservations ['5a9d3b36-9f3b-4e6c-a299-12344e5adedb', '258e63a9-9e87-401c-84be-2167ccfbfa33', '60eb4973-85ab-4da6-8f96-114399aa12be', '5abc013b-188a-4874-b7b2-31f9241f8d3c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:04 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Delete snapshot completed successfully. Jul 23 03:33:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9de2410d-da31-4be0-9c7e-5d99c7c6634a tempest-VolumeDependencyTests-274990024 None] Lock "cinder-a88f73bf-170a-4ea1-b492-2e755cf61b66-delete_snapshot" released by "delete_snapshot" :: held 1.591s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Acquiring lock "cinder-51db6683-d1e3-44ea-9225-b73d5bba57d3-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Lock "cinder-51db6683-d1e3-44ea-9225-b73d5bba57d3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Acquiring lock "cinder-quobyte-51db6683-d1e3-44ea-9225-b73d5bba57d3" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-51db6683-d1e3-44ea-9225-b73d5bba57d3" acquired by "delete_volume" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d7bf43-2411-4c14-9a99-7832d2c60d63]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:05 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 Jul 23 03:33:05 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:05 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3" returned: 0 in 0.365s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:05 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3 Jul 23 03:33:05 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:06 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-51db6683-d1e3-44ea-9225-b73d5bba57d3" returned: 0 in 0.253s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-51db6683-d1e3-44ea-9225-b73d5bba57d3" released by "delete_volume" :: held 0.682s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Created reservations ['c73a706c-1de5-42f6-b2db-6a1f99600d63', '62c80ed7-feda-4b30-aecf-98521c3039ff', 'c1987667-3cda-4e54-8af6-a2bd3282d734', 'cfc766d7-b59c-4755-9963-800c71b723c1'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:06 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:33:06 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:06 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.285s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:06 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Deleted volume successfully. Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-af473737-e3fd-4caa-940b-876bbe594436 tempest-VolumeDependencyTests-274990024 None] Lock "cinder-51db6683-d1e3-44ea-9225-b73d5bba57d3-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Acquiring lock "cinder-7fa7f305-97c9-4a29-b1b7-494c1ff40401-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Lock "cinder-7fa7f305-97c9-4a29-b1b7-494c1ff40401-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Acquiring lock "cinder-quobyte-7fa7f305-97c9-4a29-b1b7-494c1ff40401" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-7fa7f305-97c9-4a29-b1b7-494c1ff40401" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde79b70-c7e2-4490-bfdb-98ce19a8deaf]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:06 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 Jul 23 03:33:06 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:06 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:33:06 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:07 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:07 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401" returned: 0 in 0.390s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.279s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:33:07 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401 Jul 23 03:33:07 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:07 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7fa7f305-97c9-4a29-b1b7-494c1ff40401" returned: 0 in 0.284s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Lock "cinder-quobyte-7fa7f305-97c9-4a29-b1b7-494c1ff40401" released by "delete_volume" :: held 0.728s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=245,cinder:SELECT=176,cinder:INSERT=60,cinder:DELETE=20 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Created reservations ['85f4edb8-7cc5-4144-bb0b-30dd264108eb', '91ac8f2d-5065-468d-82e7-15b19c310ef3', 'd3d222c9-c3a2-47b4-90b3-a99adbfa5466', '5854fb4c-ce8d-4da3-acc2-a6859b6b7b5d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:07 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:33:07 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:07 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.294s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:07 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Deleted volume successfully. Jul 23 03:33:07 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-69b1a288-25a0-4eee-a204-6a6ad4ca6427 tempest-VolumeDependencyTests-274990024 None] Lock "cinder-7fa7f305-97c9-4a29-b1b7-494c1ff40401-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Flow 'volume_create_manager' (2fbe9308-d9cb-47e0-b23a-d7b6ad126d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ee151c-6160-44a6-8c77-8a82722ada02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ee151c-6160-44a6-8c77-8a82722ada02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1372295792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00395c5c-ba88-4130-a880-1ebe31a68dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ad5d602ce049ca9470b033252687a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:12Z,use_quota=True,user_id='97978388030a48b8b88a5165eb12937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33ad203-da99-4be8-a1b8-76d8097ffafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33ad203-da99-4be8-a1b8-76d8097ffafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b456a27-3d8e-4bad-9b57-3dc45ffb1cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b456a27-3d8e-4bad-9b57-3dc45ffb1cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00395c5c-ba88-4130-a880-1ebe31a68dcd', 'volume_name': 'volume-00395c5c-ba88-4130-a880-1ebe31a68dcd', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d8dd61-1432-4d30-9b29-e752ddfcc278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d8dd61-1432-4d30-9b29-e752ddfcc278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e4d0a8-c10a-4853-bec1-2760b0c5c9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:11 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Volume 00395c5c-ba88-4130-a880-1ebe31a68dcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00395c5c-ba88-4130-a880-1ebe31a68dcd', 'volume_size': 1} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1372295792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00395c5c-ba88-4130-a880-1ebe31a68dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ad5d602ce049ca9470b033252687a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:12Z,use_quota=True,user_id='97978388030a48b8b88a5165eb12937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Creating volume 00395c5c-ba88-4130-a880-1ebe31a68dcd {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:11 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:33:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:11 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd 1073741824 Jul 23 03:33:11 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:12 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd 1073741824" returned: 0 in 0.453s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:12 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd Jul 23 03:33:12 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:12 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd" returned: 0 in 0.255s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e4d0a8-c10a-4853-bec1-2760b0c5c9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00395c5c-ba88-4130-a880-1ebe31a68dcd', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15240f18-a948-4010-83e1-64b906861690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:12 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Volume volume-00395c5c-ba88-4130-a880-1ebe31a68dcd (00395c5c-ba88-4130-a880-1ebe31a68dcd): created successfully Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15240f18-a948-4010-83e1-64b906861690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Flow 'volume_create_manager' (2fbe9308-d9cb-47e0-b23a-d7b6ad126d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:12 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-94c42f0f-0a0d-477a-be2d-869581bdce30 tempest-ProjectReaderTests-232292555 None] Created volume successfully. Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Acquiring lock "cinder-00395c5c-ba88-4130-a880-1ebe31a68dcd-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Lock "cinder-00395c5c-ba88-4130-a880-1ebe31a68dcd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Acquiring lock "cinder-quobyte-00395c5c-ba88-4130-a880-1ebe31a68dcd" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Lock "cinder-quobyte-00395c5c-ba88-4130-a880-1ebe31a68dcd" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[89efafd4-2fd3-4d3f-9c4f-d3b75e809c35]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:13 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd Jul 23 03:33:13 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:13 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd" returned: 0 in 0.373s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:13 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd Jul 23 03:33:13 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:13 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-00395c5c-ba88-4130-a880-1ebe31a68dcd" returned: 0 in 0.322s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Lock "cinder-quobyte-00395c5c-ba88-4130-a880-1ebe31a68dcd" released by "delete_volume" :: held 0.739s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:13 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Created reservations ['3bd0ad4e-b391-4c14-b9fc-56573be756c3', 'e25c9f25-4a29-4321-8432-d250dc30913d', 'c32eab86-aa43-4a50-9b13-46db4e860dc6', '67ed8265-c747-4e5d-ba8a-766c649ca3b8'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:13 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:33:13 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:14 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:14 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Deleted volume successfully. Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a9c6f99-b680-48cf-a9d2-d6edd644da03 tempest-ProjectReaderTests-232292555 None] Lock "cinder-00395c5c-ba88-4130-a880-1ebe31a68dcd-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Flow 'volume_create_manager' (7d5c4e71-e70c-496d-ad70-aebd8b78c558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636506d9-7bf9-4f38-99f6-b4bfd29554d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636506d9-7bf9-4f38-99f6-b4bfd29554d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-540782609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b735f22-6f26-4147-a774-76a0da919fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ad5d602ce049ca9470b033252687a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:14Z,use_quota=True,user_id='97978388030a48b8b88a5165eb12937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43a9096-dbd4-4520-88cf-a3064e3eaebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43a9096-dbd4-4520-88cf-a3064e3eaebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ae7142-92ea-44d5-889c-54ef5539089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ae7142-92ea-44d5-889c-54ef5539089f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b735f22-6f26-4147-a774-76a0da919fd2', 'volume_name': 'volume-4b735f22-6f26-4147-a774-76a0da919fd2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21db938-fe46-4e7f-894e-9591c2ea3828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21db938-fe46-4e7f-894e-9591c2ea3828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a42ac9d-6663-4d9d-9839-28a958e717ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:14 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Volume 4b735f22-6f26-4147-a774-76a0da919fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b735f22-6f26-4147-a774-76a0da919fd2', 'volume_size': 1} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-540782609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b735f22-6f26-4147-a774-76a0da919fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ad5d602ce049ca9470b033252687a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:14Z,use_quota=True,user_id='97978388030a48b8b88a5165eb12937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Creating volume 4b735f22-6f26-4147-a774-76a0da919fd2 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:14 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:33:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:14 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2 1073741824 Jul 23 03:33:14 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:15 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2 1073741824" returned: 0 in 0.465s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:15 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2 Jul 23 03:33:15 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:15 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2" returned: 0 in 0.242s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a42ac9d-6663-4d9d-9839-28a958e717ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b735f22-6f26-4147-a774-76a0da919fd2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b613ab-1cc2-4376-9899-c926126264a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:15 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Volume volume-4b735f22-6f26-4147-a774-76a0da919fd2 (4b735f22-6f26-4147-a774-76a0da919fd2): created successfully Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b613ab-1cc2-4376-9899-c926126264a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Flow 'volume_create_manager' (7d5c4e71-e70c-496d-ad70-aebd8b78c558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-817624e8-b7a5-4cee-9ae8-286365f3ebab tempest-ProjectReaderTests-232292555 None] Created volume successfully. Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Acquiring lock "cinder-4b735f22-6f26-4147-a774-76a0da919fd2-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Lock "cinder-4b735f22-6f26-4147-a774-76a0da919fd2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Acquiring lock "cinder-quobyte-4b735f22-6f26-4147-a774-76a0da919fd2" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Lock "cinder-quobyte-4b735f22-6f26-4147-a774-76a0da919fd2" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3299c156-ae9a-4df0-9751-da6d42785de7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:15 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2 Jul 23 03:33:15 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:16 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2" returned: 0 in 0.360s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:16 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2 Jul 23 03:33:16 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:16 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4b735f22-6f26-4147-a774-76a0da919fd2" returned: 0 in 0.299s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Lock "cinder-quobyte-4b735f22-6f26-4147-a774-76a0da919fd2" released by "delete_volume" :: held 0.712s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Created reservations ['29a37d32-75db-4401-9da5-581a15697029', 'a007cf24-e8c8-4564-8ee5-a07015f8225f', '300f402b-a35a-4e76-bf58-7e595a8e6966', '26b9ff5d-b55d-4487-a5ee-14da490e5de4'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:16 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:33:16 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:16 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.290s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Deleted volume successfully. Jul 23 03:33:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b0a6015-e187-401c-89c5-5231113e22cc tempest-ProjectReaderTests-232292555 None] Lock "cinder-4b735f22-6f26-4147-a774-76a0da919fd2-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:26 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=29,cinder:SELECT=12,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:33:26 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=123,cinder:INSERT=42,cinder:UPDATE=176,cinder:DELETE=18 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Flow 'volume_create_manager' (de7fd09d-3f87-470f-87e7-60838f4c1893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3a3e24-e658-45ea-941e-463129ce75bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3a3e24-e658-45ea-941e-463129ce75bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1286604536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c11922a-410c-45bc-bcb7-0b4aea38fef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1def887bf6124f6d9ddcecf0ff0c8a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:27Z,use_quota=True,user_id='d19502629f9b4a83858bea93e18442b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7951f24a-386a-4c74-899c-33fa352d2829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7951f24a-386a-4c74-899c-33fa352d2829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd8ae47-1f1d-4fef-bf2a-4ec71f726c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd8ae47-1f1d-4fef-bf2a-4ec71f726c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c11922a-410c-45bc-bcb7-0b4aea38fef1', 'volume_name': 'volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3142920d-6e0b-4c37-991b-a3ad48dd2d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3142920d-6e0b-4c37-991b-a3ad48dd2d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223fe093-5f8c-49a5-ba78-5c9904617cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:27 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Volume 0c11922a-410c-45bc-bcb7-0b4aea38fef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1', 'volume_size': 1} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1286604536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c11922a-410c-45bc-bcb7-0b4aea38fef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1def887bf6124f6d9ddcecf0ff0c8a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:27Z,use_quota=True,user_id='d19502629f9b4a83858bea93e18442b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Creating volume 0c11922a-410c-45bc-bcb7-0b4aea38fef1 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:27 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:27 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 1073741824 Jul 23 03:33:27 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:27 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 1073741824" returned: 0 in 0.435s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:27 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 Jul 23 03:33:27 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:28 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1" returned: 0 in 0.230s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223fe093-5f8c-49a5-ba78-5c9904617cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569f0702-4801-4dbb-9599-d49c30d2f502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:28 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Volume volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 (0c11922a-410c-45bc-bcb7-0b4aea38fef1): created successfully Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569f0702-4801-4dbb-9599-d49c30d2f502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Flow 'volume_create_manager' (de7fd09d-3f87-470f-87e7-60838f4c1893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:28 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-fba70b19-a49a-4f7f-9ca9-9082033b54f1 tempest-SnapshotDependencyTests-2111749831 None] Created volume successfully. Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] Creating offline snapshot 339bc124-b12c-40b8-9e0b-e0d369865bad of volume 0c11922a-410c-45bc-bcb7-0b4aea38fef1 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[893e8773-0713-45a6-85a7-1e1125dc6b84]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:28 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 Jul 23 03:33:28 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:28 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1" returned: 0 in 0.332s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:29 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad 1G Jul 23 03:33:29 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:29 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad 1G" returned: 0 in 0.372s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:29 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad Jul 23 03:33:29 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:29 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad" returned: 0 in 0.265s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:29 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad is being set with open permissions: ugo+rw Jul 23 03:33:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:29 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad Jul 23 03:33:29 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:29 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad" returned: 0 in 0.225s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:29 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.info Jul 23 03:33:29 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:30 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.info" returned: 0 in 0.237s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:30 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.info is being set with open permissions: ugo+rw Jul 23 03:33:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:30 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.info Jul 23 03:33:30 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:30 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.info" returned: 0 in 0.227s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.738s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2ffaedda-1e33-4ab0-84c5-5dcc8228e006 tempest-SnapshotDependencyTests-2111749831 None] Create snapshot completed successfully Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Flow 'volume_create_manager' (a6dfa5ec-4921-4817-a122-788ea5ce51e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc718bf2-7985-4226-86b8-c85fa4618220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc718bf2-7985-4226-86b8-c85fa4618220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744aaeea-1a97-4c2c-8fa2-24043ba76b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1def887bf6124f6d9ddcecf0ff0c8a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=339bc124-b12c-40b8-9e0b-e0d369865bad,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:33:31Z,use_quota=True,user_id='d19502629f9b4a83858bea93e18442b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb8e6c2-255f-4d3e-a66e-cde0eda79897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb8e6c2-255f-4d3e-a66e-cde0eda79897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e27f12d-0aea-4338-b511-5dea4fad6102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e27f12d-0aea-4338-b511-5dea4fad6102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '744aaeea-1a97-4c2c-8fa2-24043ba76b9a', 'volume_name': 'volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a', 'volume_size': 1, 'snapshot_id': '339bc124-b12c-40b8-9e0b-e0d369865bad'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0408ef-ce01-4dcf-bc71-bca4c24325bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0408ef-ce01-4dcf-bc71-bca4c24325bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06221429-ffbc-423c-8d32-a0971de16460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:31 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Volume 744aaeea-1a97-4c2c-8fa2-24043ba76b9a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a', 'volume_size': 1, 'snapshot_id': '339bc124-b12c-40b8-9e0b-e0d369865bad'} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "cinder-quobyte-339bc124-b12c-40b8-9e0b-e0d369865bad-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" by "_create_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-339bc124-b12c-40b8-9e0b-e0d369865bad-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Creating volume 744aaeea-1a97-4c2c-8fa2-24043ba76b9a from snapshot 339bc124-b12c-40b8-9e0b-e0d369865bad {{(pid=88392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "cinder-quobyte-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] snapshot: 339bc124-b12c-40b8-9e0b-e0d369865bad, volume: 744aaeea-1a97-4c2c-8fa2-24043ba76b9a, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8cd9f7-0586-4be8-8e25-59c47aeed815]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:31 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad Jul 23 03:33:31 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:31 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad" returned: 0 in 0.350s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41ff67a-1f2b-4871-a12b-625bf63b65f1]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:31 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 Jul 23 03:33:31 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:32 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1" returned: 0 in 0.362s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:32 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:33:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:32 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a Jul 23 03:33:32 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:36 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" returned: 0 in 3.951s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d1c560-ef35-455b-9cb7-df9b86f22e52]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:36 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 Jul 23 03:33:36 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:36 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1" returned: 0 in 0.514s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1, size 1024.00 MB, duration 3.95 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:33:36 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Converted 1024.00 MB image at 259.10 MB/s Jul 23 03:33:36 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a is being set with open permissions: ugo+rw Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:36 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a Jul 23 03:33:36 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:36 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" returned: 0 in 0.234s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" released by "_copy_volume_from_snapshot" :: held 5.496s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-339bc124-b12c-40b8-9e0b-e0d369865bad-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" released by "_create_volume_from_snapshot" :: held 5.524s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.541s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06221429-ffbc-423c-8d32-a0971de16460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a', 'volume_size': 1, 'snapshot_id': '339bc124-b12c-40b8-9e0b-e0d369865bad'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764cde70-9c2f-4fa7-a976-df140a6361c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:33:36 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Volume volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a (744aaeea-1a97-4c2c-8fa2-24043ba76b9a): created successfully Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764cde70-9c2f-4fa7-a976-df140a6361c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:33:36 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Flow 'volume_create_manager' (a6dfa5ec-4921-4817-a122-788ea5ce51e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:33:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-fd66677d-ab8f-4cb5-90a4-ef6320f15473 tempest-SnapshotDependencyTests-2111749831 None] Created volume successfully. Jul 23 03:33:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "cinder-339bc124-b12c-40b8-9e0b-e0d369865bad-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-339bc124-b12c-40b8-9e0b-e0d369865bad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "cinder-quobyte-0c11922a-410c-45bc-bcb7-0b4aea38fef1" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-0c11922a-410c-45bc-bcb7-0b4aea38fef1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "cinder-quobyte-339bc124-b12c-40b8-9e0b-e0d369865bad" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-339bc124-b12c-40b8-9e0b-e0d369865bad" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Deleting offline snapshot 339bc124-b12c-40b8-9e0b-e0d369865bad of volume 0c11922a-410c-45bc-bcb7-0b4aea38fef1 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:33:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] snapshot_file for this snap is: volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:33:37 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6efcd2-b012-40ce-bd4e-c42499731aa0]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:37 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad Jul 23 03:33:37 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:38 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad" returned: 0 in 0.345s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:33:38 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a7b2b5-b756-4351-ab8f-4633fb695a24]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:38 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 Jul 23 03:33:38 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:38 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1" returned: 0 in 0.349s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:38 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad Jul 23 03:33:38 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:38 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad" returned: 0 in 0.342s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:38 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad Jul 23 03:33:38 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:39 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1.339bc124-b12c-40b8-9e0b-e0d369865bad" returned: 0 in 0.241s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-339bc124-b12c-40b8-9e0b-e0d369865bad" released by "_delete_snapshot" :: held 1.365s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-0c11922a-410c-45bc-bcb7-0b4aea38fef1" released by "delete_snapshot" :: held 1.386s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:39 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Created reservations ['c59aab3d-4ef0-4a0e-94ba-7506109d4f72', '5d4000cc-899e-4c4d-87ce-8e371ca87a1d', '92076fb0-fada-4f31-96ad-d44bbdcf5caa', 'c9faa4e9-cf80-4460-8e41-acd149730dc7'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Delete snapshot completed successfully. Jul 23 03:33:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f505c455-07e8-454c-bf3d-2489a90b4d95 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-339bc124-b12c-40b8-9e0b-e0d369865bad-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "cinder-0c11922a-410c-45bc-bcb7-0b4aea38fef1-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:39 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-0c11922a-410c-45bc-bcb7-0b4aea38fef1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "cinder-quobyte-0c11922a-410c-45bc-bcb7-0b4aea38fef1" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-0c11922a-410c-45bc-bcb7-0b4aea38fef1" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cb0575-93d2-43c0-91bc-77e51d960fe5]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:40 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 Jul 23 03:33:40 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:40 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1" returned: 0 in 0.371s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:40 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1 Jul 23 03:33:40 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:40 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-0c11922a-410c-45bc-bcb7-0b4aea38fef1" returned: 0 in 0.244s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-0c11922a-410c-45bc-bcb7-0b4aea38fef1" released by "delete_volume" :: held 0.669s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Created reservations ['6177bad8-1125-43a9-a537-f65165e7a45b', '723cacd7-173e-4a04-b370-40b6c02cfb44', '1cacab3d-6267-4e41-adbe-81a91ef77b04', '2dfe22c8-666a-4892-a80c-011cb4af9caa'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:40 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:33:40 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:41 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.256s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:41 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Deleted volume successfully. Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "cinder-744aaeea-1a97-4c2c-8fa2-24043ba76b9a-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bba52549-3732-4266-b304-cea8abbf3df6 tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-0c11922a-410c-45bc-bcb7-0b4aea38fef1-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-744aaeea-1a97-4c2c-8fa2-24043ba76b9a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "cinder-quobyte-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" acquired by "delete_volume" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5a3196-bcef-4bba-9363-6f8c030fdc57]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:41 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a Jul 23 03:33:41 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:41 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" returned: 0 in 0.366s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:41 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a Jul 23 03:33:41 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:41 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" returned: 0 in 0.257s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-quobyte-744aaeea-1a97-4c2c-8fa2-24043ba76b9a" released by "delete_volume" :: held 0.664s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Created reservations ['7e8e6063-bf7e-409e-9ec4-9142cdb256d9', '168e66f1-2fcd-45f3-a7f7-d09efbd8ffe4', '13d5bcf5-b4ca-40ee-8ea7-121bba233719', '7670c50c-ce61-4b7c-aa13-13734730663e'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:33:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:33:42 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:33:42 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:33:42 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 23 03:33:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:33:42 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:33:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Deleted volume successfully. Jul 23 03:33:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4157d4ca-cb2b-48f5-989a-48e43c730acc tempest-SnapshotDependencyTests-2111749831 None] Lock "cinder-744aaeea-1a97-4c2c-8fa2-24043ba76b9a-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:33:51 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=23,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:33:52 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=28,cinder:SELECT=24,cinder:INSERT=7,cinder:DELETE=4 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (81b6451b-cf75-42d1-bb79-6bb78c6d7fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a55407-98ce-42a4-9e0f-903bc1d1f0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a55407-98ce-42a4-9e0f-903bc1d1f0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346672449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75163ca-c24f-4ef4-b4ec-c6f73b320ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:01Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416e1ba7-7b0f-486d-8615-dc17485dea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416e1ba7-7b0f-486d-8615-dc17485dea6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c82aa5-55ad-4d9e-a435-6d8fbc06b5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c82aa5-55ad-4d9e-a435-6d8fbc06b5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75163ca-c24f-4ef4-b4ec-c6f73b320ea3', 'volume_name': 'volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927c4641-d7f2-4097-9ff1-3e132a470521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927c4641-d7f2-4097-9ff1-3e132a470521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08813814-76c4-4bb2-878a-ea55e2a9a4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:01 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume f75163ca-c24f-4ef4-b4ec-c6f73b320ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3', 'volume_size': 1} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346672449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75163ca-c24f-4ef4-b4ec-c6f73b320ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:01Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Creating volume f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:01 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:01 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 1073741824 Jul 23 03:34:01 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Flow 'volume_create_manager' (6a48d360-16e0-40c3-8d64-598c967ee3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6a767f-8a93-4a84-a5ca-77e1268e9378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6a767f-8a93-4a84-a5ca-77e1268e9378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1009016483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cea48b6-8f61-4b07-b237-31bfc5dab468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a69498ffb1544988db3482b047ddcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:02Z,use_quota=True,user_id='d4c6c5b382b243c482f3c2e5f448e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b2f654-461a-4f8b-89d6-f61b1b7037b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b2f654-461a-4f8b-89d6-f61b1b7037b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c767872-b1f4-497a-a115-8d1e0ec638ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c767872-b1f4-497a-a115-8d1e0ec638ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cea48b6-8f61-4b07-b237-31bfc5dab468', 'volume_name': 'volume-8cea48b6-8f61-4b07-b237-31bfc5dab468', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d984307-f806-4a12-bd14-ed71ba0b7f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d984307-f806-4a12-bd14-ed71ba0b7f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02337b3b-41b8-4587-9739-819422a91051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:01 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Volume 8cea48b6-8f61-4b07-b237-31bfc5dab468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cea48b6-8f61-4b07-b237-31bfc5dab468', 'volume_size': 1} Jul 23 03:34:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Flow 'volume_create_manager' (f620fb42-1b07-4c70-a02b-293d66e8f7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec91785-961c-4d87-a2ff-ace7c0bac73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec91785-961c-4d87-a2ff-ace7c0bac73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-398844256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cebc66c-7291-4c22-82e5-2f5877a32bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a69498ffb1544988db3482b047ddcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:02Z,use_quota=True,user_id='d4c6c5b382b243c482f3c2e5f448e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad63682-1172-4540-b0c0-9c897bf5084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad63682-1172-4540-b0c0-9c897bf5084d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d39e581-16d1-4cc4-9ab7-2903d43e1664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d39e581-16d1-4cc4-9ab7-2903d43e1664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cebc66c-7291-4c22-82e5-2f5877a32bfb', 'volume_name': 'volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0491608-06ee-47c3-8657-58a4a31db8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0491608-06ee-47c3-8657-58a4a31db8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d25bcf7-76d2-4404-afc3-8580a323cee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Volume 1cebc66c-7291-4c22-82e5-2f5877a32bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb', 'volume_size': 1} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:02 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 1073741824" returned: 0 in 0.700s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:02 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 Jul 23 03:34:02 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (23c36ca2-8bc3-4a3b-977c-3d8cfa5d53d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811afcf4-00fd-492b-91a1-9a41ce41a02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811afcf4-00fd-492b-91a1-9a41ce41a02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527974477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c04b9d0-5557-47ec-a28f-a9a0e299812a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:02Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ede8156-ceec-49e1-a824-9e95dcef9f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ede8156-ceec-49e1-a824-9e95dcef9f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891cfc85-f914-4d6a-8cea-6e84e9780be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891cfc85-f914-4d6a-8cea-6e84e9780be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c04b9d0-5557-47ec-a28f-a9a0e299812a', 'volume_name': 'volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d2f5f9-7531-4124-9d79-3de16f7cb5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d2f5f9-7531-4124-9d79-3de16f7cb5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d06109-dd90-4946-bddf-f184e6c1a5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume 4c04b9d0-5557-47ec-a28f-a9a0e299812a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a', 'volume_size': 1} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:02 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Flow 'volume_create_manager' (ec6b41d0-0b81-46d6-b1a0-8cc8dedf791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba70f250-f055-44b6-b560-e0c6abd3d7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3" returned: 0 in 0.407s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.858s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1009016483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cea48b6-8f61-4b07-b237-31bfc5dab468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a69498ffb1544988db3482b047ddcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:02Z,use_quota=True,user_id='d4c6c5b382b243c482f3c2e5f448e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Creating volume 8cea48b6-8f61-4b07-b237-31bfc5dab468 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:02 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba70f250-f055-44b6-b560-e0c6abd3d7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-757059090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b25b75-0c98-427e-8d29-916873da4c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a69498ffb1544988db3482b047ddcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:03Z,use_quota=True,user_id='d4c6c5b382b243c482f3c2e5f448e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468 1073741824 Jul 23 03:34:02 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ac303c-b692-4177-9e0c-696d32a60873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ac303c-b692-4177-9e0c-696d32a60873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6191c9e8-57f2-4b11-b1d1-dd33d1549b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6191c9e8-57f2-4b11-b1d1-dd33d1549b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b25b75-0c98-427e-8d29-916873da4c84', 'volume_name': 'volume-20b25b75-0c98-427e-8d29-916873da4c84', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41272dc7-5646-4fa7-80f2-83e497b13ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41272dc7-5646-4fa7-80f2-83e497b13ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74d5593-380a-48bd-b86d-70bfdbc46859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Volume 20b25b75-0c98-427e-8d29-916873da4c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b25b75-0c98-427e-8d29-916873da4c84', 'volume_size': 1} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08813814-76c4-4bb2-878a-ea55e2a9a4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed37a9f3-67c8-474b-8555-7b872228676e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:02 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 (f75163ca-c24f-4ef4-b4ec-c6f73b320ea3): created successfully Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed37a9f3-67c8-474b-8555-7b872228676e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (81b6451b-cf75-42d1-bb79-6bb78c6d7fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:02 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f93e3886-2a54-420a-b230-f58d80c77ccf tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created volume successfully. Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Flow 'volume_create_manager' (a0f2e1e3-3d4f-4258-815d-3356d037c8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50cb9a1-02d3-4b48-84ec-9ffac3841ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50cb9a1-02d3-4b48-84ec-9ffac3841ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1349132640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e1404e-d51c-43ca-b056-43ecad007c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a69498ffb1544988db3482b047ddcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:03Z,use_quota=True,user_id='d4c6c5b382b243c482f3c2e5f448e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9717ef5-a484-4337-b4af-32cf9c385994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9717ef5-a484-4337-b4af-32cf9c385994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1434a46-c3c3-4325-ac67-eff33608f5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1434a46-c3c3-4325-ac67-eff33608f5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e1404e-d51c-43ca-b056-43ecad007c6f', 'volume_name': 'volume-a9e1404e-d51c-43ca-b056-43ecad007c6f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be138f73-7400-47fa-8d24-aa748c53717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be138f73-7400-47fa-8d24-aa748c53717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f7c4ac-2a76-4a81-ba44-fa7d89e41631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:03 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Volume a9e1404e-d51c-43ca-b056-43ecad007c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e1404e-d51c-43ca-b056-43ecad007c6f', 'volume_size': 1} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:03 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468 1073741824" returned: 0 in 0.577s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:03 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468 Jul 23 03:34:03 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Flow 'volume_create_manager' (f00bf43c-48ae-4694-b48e-2e7d3dd9eb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30805179-ea74-4f03-8bad-a104e4cedb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30805179-ea74-4f03-8bad-a104e4cedb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1620321591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ffc44d1-86d4-42f9-9f7c-acdb894b94c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a69498ffb1544988db3482b047ddcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:03Z,use_quota=True,user_id='d4c6c5b382b243c482f3c2e5f448e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59c4e44-2e4a-47d2-8eac-628d9f82d3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59c4e44-2e4a-47d2-8eac-628d9f82d3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882b3942-6570-4e24-897e-062f56ce287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882b3942-6570-4e24-897e-062f56ce287d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ffc44d1-86d4-42f9-9f7c-acdb894b94c2', 'volume_name': 'volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81927d99-0fd3-41a9-86cd-8a8071a9a002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81927d99-0fd3-41a9-86cd-8a8071a9a002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851f3a42-5d7b-4669-863e-8dac24633595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:03 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Volume 8ffc44d1-86d4-42f9-9f7c-acdb894b94c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2', 'volume_size': 1} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:03 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468" returned: 0 in 0.302s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.425s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-398844256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cebc66c-7291-4c22-82e5-2f5877a32bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a69498ffb1544988db3482b047ddcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:02Z,use_quota=True,user_id='d4c6c5b382b243c482f3c2e5f448e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Creating volume 1cebc66c-7291-4c22-82e5-2f5877a32bfb {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:03 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:03 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb 1073741824 Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02337b3b-41b8-4587-9739-819422a91051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cea48b6-8f61-4b07-b237-31bfc5dab468', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:03 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec08ef25-20f5-4831-8321-21b6b30e9d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:03 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Volume volume-8cea48b6-8f61-4b07-b237-31bfc5dab468 (8cea48b6-8f61-4b07-b237-31bfc5dab468): created successfully Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec08ef25-20f5-4831-8321-21b6b30e9d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Flow 'volume_create_manager' (6a48d360-16e0-40c3-8d64-598c967ee3fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:03 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-407cb39c-164b-40a8-994c-46451d13de9a tempest-CreateVolumesFromImageTest-1451274547 None] Created volume successfully. Jul 23 03:34:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:04 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb 1073741824" returned: 0 in 0.503s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:04 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb Jul 23 03:34:04 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:04 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb" returned: 0 in 0.246s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527974477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c04b9d0-5557-47ec-a28f-a9a0e299812a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:02Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Creating volume 4c04b9d0-5557-47ec-a28f-a9a0e299812a {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:04 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d25bcf7-76d2-4404-afc3-8580a323cee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:04 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a 1073741824 Jul 23 03:34:04 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767ba1fc-d422-4ed4-85de-da010a852ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:04 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Volume volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb (1cebc66c-7291-4c22-82e5-2f5877a32bfb): created successfully Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767ba1fc-d422-4ed4-85de-da010a852ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Flow 'volume_create_manager' (f620fb42-1b07-4c70-a02b-293d66e8f7f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:04 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f1b2e099-617c-4bfd-8185-92111ab7b81a tempest-CreateVolumesFromImageTest-1451274547 None] Created volume successfully. Jul 23 03:34:04 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a 1073741824" returned: 0 in 0.441s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:04 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a Jul 23 03:34:04 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:05 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a" returned: 0 in 0.243s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.370s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-757059090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b25b75-0c98-427e-8d29-916873da4c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a69498ffb1544988db3482b047ddcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:03Z,use_quota=True,user_id='d4c6c5b382b243c482f3c2e5f448e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Creating volume 20b25b75-0c98-427e-8d29-916873da4c84 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:05 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d06109-dd90-4946-bddf-f184e6c1a5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:05 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84 1073741824 Jul 23 03:34:05 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57110d8-ef3a-4657-b30c-6031d7752afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:05 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a (4c04b9d0-5557-47ec-a28f-a9a0e299812a): created successfully Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57110d8-ef3a-4657-b30c-6031d7752afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (23c36ca2-8bc3-4a3b-977c-3d8cfa5d53d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:05 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-dfc47c87-b952-4f37-b1ac-e93483850995 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created volume successfully. Jul 23 03:34:05 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84 1073741824" returned: 0 in 0.491s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Flow 'volume_create_manager' (7fd3f485-78ba-4f02-bb80-2e6d30f700a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c11ef1-8177-4cd5-876f-850fac043240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:05 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84 Jul 23 03:34:05 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c11ef1-8177-4cd5-876f-850fac043240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b0b3b7-20d9-448e-97f0-f04587fafbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede45bed040846ef858880e1759c5b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:06Z,use_quota=True,user_id='c0f435fded874a7b8fa4ac4f56fbadeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a0d5fce-9db8-46bf-b924-69e14afc0fb6),volume_type_id=5a0d5fce-9db8-46bf-b924-69e14afc0fb6)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db694ab6-ffcb-4184-b6f4-a5a78017a675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db694ab6-ffcb-4184-b6f4-a5a78017a675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8caed837-d02f-4129-b408-c05901a43c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:05 devstack cinder-volume[88392]: DEBUG cinder.image.glance [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Creating Keystone auth plugin from conf {{(pid=88392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:34:05 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84" returned: 0 in 0.247s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.826s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1349132640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e1404e-d51c-43ca-b056-43ecad007c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a69498ffb1544988db3482b047ddcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:03Z,use_quota=True,user_id='d4c6c5b382b243c482f3c2e5f448e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Creating volume a9e1404e-d51c-43ca-b056-43ecad007c6f {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:06 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:06 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f 1073741824 Jul 23 03:34:06 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74d5593-380a-48bd-b86d-70bfdbc46859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b25b75-0c98-427e-8d29-916873da4c84', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1be1ad1-e617-4bc0-9db3-cfa34916ac30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:06 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Volume volume-20b25b75-0c98-427e-8d29-916873da4c84 (20b25b75-0c98-427e-8d29-916873da4c84): created successfully Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1be1ad1-e617-4bc0-9db3-cfa34916ac30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Flow 'volume_create_manager' (ec6b41d0-0b81-46d6-b1a0-8cc8dedf791b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:06 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f5a6a3c7-ed1f-4646-a72a-306b048f9e47 tempest-CreateVolumesFromImageTest-1451274547 None] Created volume successfully. Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8caed837-d02f-4129-b408-c05901a43c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8b0b3b7-20d9-448e-97f0-f04587fafbfb', 'volume_name': 'volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb', 'volume_size': 1, 'image_id': 'a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e8dc03915950e18ddafbbf843e9dced', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ede45bed040846ef858880e1759c5b7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '075dcac90d0d3ad920afac3bd77091ba3e59240377e6f2acbd953803b3187e82b981f8c61e020974f9cc96a4ffa618119a171934d893e7eed0b42e490f8a3eef', 'id': 'a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'created_at': datetime.datetime(2026, 7, 23, 1, 34, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 34, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2a00c0b-f249-4bf5-92a8-1c0a1de471cd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ee1ee9-de08-469d-a981-169c549380ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ee1ee9-de08-469d-a981-169c549380ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec88acca-3d52-4536-a17a-3886f9ce8850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:06 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Volume a8b0b3b7-20d9-448e-97f0-f04587fafbfb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb', 'volume_size': 1, 'image_id': 'a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e8dc03915950e18ddafbbf843e9dced', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ede45bed040846ef858880e1759c5b7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '075dcac90d0d3ad920afac3bd77091ba3e59240377e6f2acbd953803b3187e82b981f8c61e020974f9cc96a4ffa618119a171934d893e7eed0b42e490f8a3eef', 'id': 'a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'created_at': datetime.datetime(2026, 7, 23, 1, 34, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 34, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2a00c0b-f249-4bf5-92a8-1c0a1de471cd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Trying to clone a8b0b3b7-20d9-448e-97f0-f04587fafbfb from image a2a00c0b-f249-4bf5-92a8-1c0a1de471cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'metadata': {}}]). {{(pid=88392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:34:06 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[94694790-6830-4989-8db7-268dd29e0007]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:06 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD Jul 23 03:34:06 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:06 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f 1073741824" returned: 0 in 0.473s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:06 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f Jul 23 03:34:06 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:06 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:06 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD Jul 23 03:34:06 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:06 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f" returned: 0 in 0.445s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:06 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.469s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1620321591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ffc44d1-86d4-42f9-9f7c-acdb894b94c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a69498ffb1544988db3482b047ddcf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:03Z,use_quota=True,user_id='d4c6c5b382b243c482f3c2e5f448e5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Creating volume 8ffc44d1-86d4-42f9-9f7c-acdb894b94c2 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:06 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:07 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f7c4ac-2a76-4a81-ba44-fa7d89e41631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e1404e-d51c-43ca-b056-43ecad007c6f', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25af8016-3aa2-45d5-bc09-301784500127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2 1073741824 Jul 23 03:34:07 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (4b84e913-095c-46e5-acc9-6b96ab3ede0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:07 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1c48b8-acba-45cc-8550-1f3fb01520e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Volume volume-a9e1404e-d51c-43ca-b056-43ecad007c6f (a9e1404e-d51c-43ca-b056-43ecad007c6f): created successfully Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25af8016-3aa2-45d5-bc09-301784500127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Flow 'volume_create_manager' (a0f2e1e3-3d4f-4258-815d-3356d037c8e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD" returned: 1 in 0.497s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Temporary image a2a00c0b-f249-4bf5-92a8-1c0a1de471cd is fetched for user c0f435fded874a7b8fa4ac4f56fbadeb. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1c48b8-acba-45cc-8550-1f3fb01520e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575161995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702c8b78-a04a-4669-b8cd-e7b3ac39c32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:07Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93f7337-1551-4f8b-a2bd-a6d4bbf23c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93f7337-1551-4f8b-a2bd-a6d4bbf23c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45815afd-ba82-4512-999c-e70292419387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45815afd-ba82-4512-999c-e70292419387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702c8b78-a04a-4669-b8cd-e7b3ac39c32c', 'volume_name': 'volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cec1c79-1bda-4be0-9a78-6700d5221a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cec1c79-1bda-4be0-9a78-6700d5221a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b69f62-8355-4505-93a6-3e8b9db5425f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume 702c8b78-a04a-4669-b8cd-e7b3ac39c32c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c', 'volume_size': 1} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:07 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2b85ad9b-86e6-479d-9da0-7bba03c10e7e tempest-CreateVolumesFromImageTest-1451274547 None] Created volume successfully. Jul 23 03:34:07 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.407s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (ab7580ca-535e-456a-b7bd-dfd0e67ad263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecd692a-c9fd-4e7a-b69b-e550041dd346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecd692a-c9fd-4e7a-b69b-e550041dd346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1954600148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6970246-8ce9-4999-948b-0ff5a0f7c7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:07Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14c1b1b-5eac-4c71-9ae3-a4870445896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14c1b1b-5eac-4c71-9ae3-a4870445896b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963039b9-43e7-455b-a5a6-0a3d7d589700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963039b9-43e7-455b-a5a6-0a3d7d589700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6970246-8ce9-4999-948b-0ff5a0f7c7a0', 'volume_name': 'volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73d1f29-4a26-4f8b-aa3d-953bbb849e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73d1f29-4a26-4f8b-aa3d-953bbb849e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bada16-db24-4550-bc2e-70282aea331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume a6970246-8ce9-4999-948b-0ff5a0f7c7a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0', 'volume_size': 1} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bab8b3d-d6e2-4224-8fcd-06ce35e3c004]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:07 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD Jul 23 03:34:07 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:07 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2 1073741824" returned: 0 in 0.702s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:07 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2 Jul 23 03:34:07 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (9e5ec21f-3b6a-4d81-b52b-8a4ac1e67047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:07 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b090e040-f8a7-41ca-9dad-1fbe7edfc0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b090e040-f8a7-41ca-9dad-1fbe7edfc0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-36255478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2820b09-c06f-4d82-8745-be75b0086fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:08Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b1a899-a8fd-4a29-afd7-b5dd8c2509ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b1a899-a8fd-4a29-afd7-b5dd8c2509ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b5c625-b53d-46c3-88a7-9136f88bde1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b5c625-b53d-46c3-88a7-9136f88bde1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2820b09-c06f-4d82-8745-be75b0086fda', 'volume_name': 'volume-f2820b09-c06f-4d82-8745-be75b0086fda', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9f17a6-4cde-478e-8d76-744f9f187471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9f17a6-4cde-478e-8d76-744f9f187471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9614b59b-4e34-4fef-82a0-cbc504dd0971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume f2820b09-c06f-4d82-8745-be75b0086fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2820b09-c06f-4d82-8745-be75b0086fda', 'volume_size': 1} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:08 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2" returned: 0 in 0.292s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:08 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD Jul 23 03:34:08 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.291s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851f3a42-5d7b-4669-863e-8dac24633595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fac6e4e-95ab-4065-a84e-a1d9523d8fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] Creating offline snapshot 9881e132-5826-44bc-9bd0-8eb1045c4a4a of volume f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:34:08 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Volume volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2 (8ffc44d1-86d4-42f9-9f7c-acdb894b94c2): created successfully Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fac6e4e-95ab-4065-a84e-a1d9523d8fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Flow 'volume_create_manager' (f00bf43c-48ae-4694-b48e-2e7d3dd9eb03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd1c858-0ef2-462e-8daa-738339b4a8f8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:08 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7679112d-db5e-43cb-8cdb-008d64fc6fd0 tempest-CreateVolumesFromImageTest-1451274547 None] Created volume successfully. Jul 23 03:34:08 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:08 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 Jul 23 03:34:08 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (406bbc7c-b2b8-40b0-bd3a-48f9ace95998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f88678e-ef2d-4418-a28b-7110f3841010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f88678e-ef2d-4418-a28b-7110f3841010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305140955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3165bd-7865-4bca-8e23-f4e21742adc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:08Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756a02ec-5db8-42d5-a1e5-b8b43e808715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756a02ec-5db8-42d5-a1e5-b8b43e808715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e936a5-c6e6-4b46-bb88-b71eaa2d1261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e936a5-c6e6-4b46-bb88-b71eaa2d1261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3165bd-7865-4bca-8e23-f4e21742adc9', 'volume_name': 'volume-ee3165bd-7865-4bca-8e23-f4e21742adc9', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7aa338-a7c1-4744-a23c-5383bd623508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7aa338-a7c1-4744-a23c-5383bd623508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a4d82d-0f09-4224-bc06-23a820069650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume ee3165bd-7865-4bca-8e23-f4e21742adc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3165bd-7865-4bca-8e23-f4e21742adc9', 'volume_size': 1} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:08 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3" returned: 0 in 0.434s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:08 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a 1G Jul 23 03:34:08 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (b6846b18-d2eb-4e9e-908a-2d358b467135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d92d121-a567-48ad-9955-8925fbb96973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d92d121-a567-48ad-9955-8925fbb96973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371576345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dbc10f-2271-4d4b-ac29-d7fd563ee37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:09Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d7f454-0c0c-44ee-973d-87a25e557a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d7f454-0c0c-44ee-973d-87a25e557a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e579f0af-e6a2-4c2a-9893-3cd087bd10fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e579f0af-e6a2-4c2a-9893-3cd087bd10fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57dbc10f-2271-4d4b-ac29-d7fd563ee37d', 'volume_name': 'volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9d4e01-8333-4974-a719-aee992de958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9d4e01-8333-4974-a719-aee992de958e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aabfbe6-7207-48be-8dfd-3b6770a00bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:08 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume 57dbc10f-2271-4d4b-ac29-d7fd563ee37d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d', 'volume_size': 1} Jul 23 03:34:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:09 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a 1G" returned: 0 in 0.414s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "cinder-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:09 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a Jul 23 03:34:09 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "cinder-quobyte-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-quobyte-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f964ce-d438-439a-ad3e-f73873619e3a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:09 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2 Jul 23 03:34:09 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:09 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a" returned: 0 in 0.307s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:09 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a is being set with open permissions: ugo+rw Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:09 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a Jul 23 03:34:09 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:09 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2" returned: 0 in 0.363s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:09 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2 Jul 23 03:34:09 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:09 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a" returned: 0 in 0.233s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:09 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.info Jul 23 03:34:09 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:09 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2" returned: 0 in 0.252s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-quobyte-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2" released by "delete_volume" :: held 0.664s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Created reservations ['a016f621-5541-4615-9ff5-be80a1665d5f', '23c0bb32-4094-4d06-a8f5-4c903b7c68c4', '98806a18-b35d-42de-bd78-6007bec0d48b', '35bbb4a3-5a3e-41aa-bd13-24d717d26a7d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:09 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.info" returned: 0 in 0.296s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:09 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.info is being set with open permissions: ugo+rw Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:09 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.info Jul 23 03:34:09 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:09 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:09 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:10 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.info" returned: 0 in 0.283s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:10 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.897s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575161995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702c8b78-a04a-4669-b8cd-e7b3ac39c32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:07Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Creating volume 702c8b78-a04a-4669-b8cd-e7b3ac39c32c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:10 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "cinder-a9e1404e-d51c-43ca-b056-43ecad007c6f-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:10 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c 1073741824 Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.291s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:10 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:10 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Deleted volume successfully. Jul 23 03:34:10 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-59945e07-0b0c-4999-9977-2ecd742168ab tempest-CreateVolumesFromSnapshotTest-1203340351 None] Create snapshot completed successfully Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-a9e1404e-d51c-43ca-b056-43ecad007c6f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-03fd9496-3f5f-421c-9114-6ebada15c46c tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-8ffc44d1-86d4-42f9-9f7c-acdb894b94c2-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "cinder-quobyte-a9e1404e-d51c-43ca-b056-43ecad007c6f" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-quobyte-a9e1404e-d51c-43ca-b056-43ecad007c6f" acquired by "delete_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dda137-daa4-41ad-97d2-e0c65842fb01]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:10 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f Jul 23 03:34:10 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:10 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c 1073741824" returned: 0 in 0.426s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:10 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c Jul 23 03:34:10 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:10 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f" returned: 0 in 0.385s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:10 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f Jul 23 03:34:10 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:10 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c" returned: 0 in 0.239s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.431s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1954600148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6970246-8ce9-4999-948b-0ff5a0f7c7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:07Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Creating volume a6970246-8ce9-4999-948b-0ff5a0f7c7a0 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:10 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b69f62-8355-4505-93a6-3e8b9db5425f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34589552-db84-4769-bbd7-80f74de5de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:10 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0 1073741824 Jul 23 03:34:10 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:10 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c (702c8b78-a04a-4669-b8cd-e7b3ac39c32c): created successfully Jul 23 03:34:10 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34589552-db84-4769-bbd7-80f74de5de1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:10 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (4b84e913-095c-46e5-acc9-6b96ab3ede0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a9e1404e-d51c-43ca-b056-43ecad007c6f" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-quobyte-a9e1404e-d51c-43ca-b056-43ecad007c6f" released by "delete_volume" :: held 0.687s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d3fcb117-15ae-479b-bd0f-34b9d2975119 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created volume successfully. Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Created reservations ['d01d2faf-ea8c-4d3b-a3c4-ba905c30f52c', '3c5096b3-d0c1-4862-9403-3c769c1e677c', '145c9e86-4329-4204-ab93-2e4e9905c279', 'be81ea86-e153-4858-878c-4d0a70d11ecf'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:11 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:11 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "cinder-20b25b75-0c98-427e-8d29-916873da4c84-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:11 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.298s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-20b25b75-0c98-427e-8d29-916873da4c84-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Deleted volume successfully. Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2067c742-b4fd-45dd-8273-1ba4ebceb2f1 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-a9e1404e-d51c-43ca-b056-43ecad007c6f-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "cinder-quobyte-20b25b75-0c98-427e-8d29-916873da4c84" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:11 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0 1073741824" returned: 0 in 0.579s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-quobyte-20b25b75-0c98-427e-8d29-916873da4c84" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c248c0-b2a3-4880-9302-819f5dca7b7f]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:11 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0 Jul 23 03:34:11 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:11 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84 Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (e5168148-1150-41ed-b625-6da718637ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:11 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b921e0-2ee9-4a6f-b3c1-ac120f613929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b921e0-2ee9-4a6f-b3c1-ac120f613929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-421559201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3414d65e-22ff-4536-96f6-a7aa7e91d15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:12Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd53cd2-e846-4a08-9e4f-869aa75c84ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd53cd2-e846-4a08-9e4f-869aa75c84ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a30752-06d2-45f4-9d03-9775d18b20fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a30752-06d2-45f4-9d03-9775d18b20fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3414d65e-22ff-4536-96f6-a7aa7e91d15d', 'volume_name': 'volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e08d1b-9b11-4089-8608-ecd6a015bba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e08d1b-9b11-4089-8608-ecd6a015bba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb269dff-3c65-45d9-83f4-b2452ee4243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:11 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume 3414d65e-22ff-4536-96f6-a7aa7e91d15d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d', 'volume_size': 1} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:11 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0" returned: 0 in 0.338s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.918s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-36255478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2820b09-c06f-4d82-8745-be75b0086fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:08Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Creating volume f2820b09-c06f-4d82-8745-be75b0086fda {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:11 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bada16-db24-4550-bc2e-70282aea331d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcc9349-1ffd-41fb-be6a-55b722039146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:11 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0 (a6970246-8ce9-4999-948b-0ff5a0f7c7a0): created successfully Jul 23 03:34:11 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda 1073741824 Jul 23 03:34:11 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcc9349-1ffd-41fb-be6a-55b722039146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:11 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (ab7580ca-535e-456a-b7bd-dfd0e67ad263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:12 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a471b566-4a7a-44db-9428-0256e1ccefb2 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created volume successfully. Jul 23 03:34:12 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84" returned: 0 in 0.529s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:12 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84 Jul 23 03:34:12 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (665c9eff-ef7d-4a7b-8238-ed3d47cfd499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a07cc2-ea7b-4119-9d61-95f76807d58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a07cc2-ea7b-4119-9d61-95f76807d58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2124612738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ccd001-2d05-4763-a06c-b7c2d68a3b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:12Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6852a99e-d553-49b3-b06d-eb0c3a4349ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6852a99e-d553-49b3-b06d-eb0c3a4349ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed72811-f755-46fc-8591-bc5fd13fc4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed72811-f755-46fc-8591-bc5fd13fc4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ccd001-2d05-4763-a06c-b7c2d68a3b1a', 'volume_name': 'volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4c6b5a-5e6e-45a5-93f2-d89b5957fa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4c6b5a-5e6e-45a5-93f2-d89b5957fa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4894bfcb-ed8a-4ea3-b815-fef3174dfab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:12 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume 62ccd001-2d05-4763-a06c-b7c2d68a3b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a', 'volume_size': 1} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:12 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-20b25b75-0c98-427e-8d29-916873da4c84" returned: 0 in 0.307s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-quobyte-20b25b75-0c98-427e-8d29-916873da4c84" released by "delete_volume" :: held 0.886s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Created reservations ['d72fdf2d-5736-44dd-bc17-5b151926738a', 'dead0e48-774e-46c6-b1fb-894b390b83d4', 'a7dc421f-2817-4025-817e-92b4e2434bc1', '23fa719a-b0aa-42ad-9642-7430bea7be73'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:12 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda 1073741824" returned: 0 in 0.609s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (501376b6-51e1-4635-a47e-d4b03d9f3218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27dbb5b7-0a91-4c78-83d7-fa8c71d5cf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27dbb5b7-0a91-4c78-83d7-fa8c71d5cf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493653097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7a3c30-422e-44f6-b25d-79ccdbd0c03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:12Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50513586-2787-4ace-9c1a-203a239a900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50513586-2787-4ace-9c1a-203a239a900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5995b5a-a4db-4b61-bdfc-c68ee0384d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5995b5a-a4db-4b61-bdfc-c68ee0384d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a7a3c30-422e-44f6-b25d-79ccdbd0c03a', 'volume_name': 'volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e172a5fc-7664-4dd6-8b9c-33209077f2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e172a5fc-7664-4dd6-8b9c-33209077f2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14366d7a-5edb-408d-ad17-db07ff7b0ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:12 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume 3a7a3c30-422e-44f6-b25d-79ccdbd0c03a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a', 'volume_size': 1} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "cinder-1cebc66c-7291-4c22-82e5-2f5877a32bfb-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-1cebc66c-7291-4c22-82e5-2f5877a32bfb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:12 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda Jul 23 03:34:12 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:12 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:12 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "cinder-quobyte-1cebc66c-7291-4c22-82e5-2f5877a32bfb" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-quobyte-1cebc66c-7291-4c22-82e5-2f5877a32bfb" acquired by "delete_volume" :: waited 0.031s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[958067f5-718e-4c58-b8c5-fc4ba9b6b29c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:13 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb Jul 23 03:34:13 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:13 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda" returned: 0 in 0.403s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.759s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b0b3b7-20d9-448e-97f0-f04587fafbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede45bed040846ef858880e1759c5b7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:06Z,use_quota=True,user_id='c0f435fded874a7b8fa4ac4f56fbadeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a0d5fce-9db8-46bf-b924-69e14afc0fb6),volume_type_id=5a0d5fce-9db8-46bf-b924-69e14afc0fb6)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Creating volume a8b0b3b7-20d9-448e-97f0-f04587fafbfb {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:13 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:13 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.426s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9614b59b-4e34-4fef-82a0-cbc504dd0971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2820b09-c06f-4d82-8745-be75b0086fda', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7a583b-f365-478a-873b-dd00cbf70d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:13 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb 1073741824 Jul 23 03:34:13 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Deleted volume successfully. Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (e8a6e747-3e88-4403-8e72-3eab7eacdd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d26d07d-90f6-4acc-b0bf-69f839a56169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:13 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume volume-f2820b09-c06f-4d82-8745-be75b0086fda (f2820b09-c06f-4d82-8745-be75b0086fda): created successfully Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7a583b-f365-478a-873b-dd00cbf70d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (9e5ec21f-3b6a-4d81-b52b-8a4ac1e67047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d26d07d-90f6-4acc-b0bf-69f839a56169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989603314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b05fb7-0cd0-4f19-a920-ea455d4d0f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:13Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81400a0b-ba62-486b-b8fc-b275212e6d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:13 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81400a0b-ba62-486b-b8fc-b275212e6d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fec2ab-c2e3-4582-b4d9-dba21140e826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fec2ab-c2e3-4582-b4d9-dba21140e826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b05fb7-0cd0-4f19-a920-ea455d4d0f64', 'volume_name': 'volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f032b47-520c-4c44-b3c0-5b6659407327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f032b47-520c-4c44-b3c0-5b6659407327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e7dd1a-c1aa-4d25-ac28-1c0f0bb2cc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:13 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume c6b05fb7-0cd0-4f19-a920-ea455d4d0f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64', 'volume_size': 1} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb" returned: 0 in 0.499s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c1440929-2769-43d1-bb01-6e0dec0dca22 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-20b25b75-0c98-427e-8d29-916873da4c84-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ab39430c-6649-4f74-b432-f29690040420 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created volume successfully. Jul 23 03:34:13 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb Jul 23 03:34:13 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (a75a2984-bf7f-44e0-a4a1-865862cbea5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7715a4b-5519-4ccd-a2d2-c2b5456a6b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7715a4b-5519-4ccd-a2d2-c2b5456a6b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809248585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77fae4a5-87a4-4d45-a617-b09cacc992f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:14Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5abb02e-fe2f-44bf-bce6-c321f65703aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5abb02e-fe2f-44bf-bce6-c321f65703aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:13 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a64890e-fb40-4641-833c-a298215264b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a64890e-fb40-4641-833c-a298215264b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77fae4a5-87a4-4d45-a617-b09cacc992f7', 'volume_name': 'volume-77fae4a5-87a4-4d45-a617-b09cacc992f7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d8e9e6-0e45-4902-a3d1-a76303cb33ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d8e9e6-0e45-4902-a3d1-a76303cb33ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:13 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b67ca22-8aa8-4c65-a46b-a9e661da915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:13 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume 77fae4a5-87a4-4d45-a617-b09cacc992f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77fae4a5-87a4-4d45-a617-b09cacc992f7', 'volume_size': 1} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1cebc66c-7291-4c22-82e5-2f5877a32bfb" returned: 0 in 0.329s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb 1073741824" returned: 0 in 0.561s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-quobyte-1cebc66c-7291-4c22-82e5-2f5877a32bfb" released by "delete_volume" :: held 0.879s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:13 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb Jul 23 03:34:13 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Created reservations ['fbc0f7b5-4d51-49de-9941-a7ae0f148e95', 'fe804674-ef78-4d39-ab42-8ab57c2bba2d', 'dd22da37-6e41-491d-9a3f-3790b09aa9f0', '8aba438e-890f-419d-93cf-6374f46f3f21'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:13 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:13 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:13 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.454s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305140955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3165bd-7865-4bca-8e23-f4e21742adc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:08Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Creating volume ee3165bd-7865-4bca-8e23-f4e21742adc9 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:14 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:14 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9 1073741824 Jul 23 03:34:14 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Attempting download of a2a00c0b-f249-4bf5-92a8-1c0a1de471cd ((None, [{'url': 'file:///opt/stack/data/glance/images/a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'metadata': {}}])) to volume a8b0b3b7-20d9-448e-97f0-f04587fafbfb. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c294ae0-c7b1-4aba-9d19-96e5be840005]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_atbajxc3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:14 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.266s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:14 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Deleted volume successfully. Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-cf69f90f-0cb3-4caf-90d0-595bd0dfe9ea tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-1cebc66c-7291-4c22-82e5-2f5877a32bfb-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:14 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_atbajxc3 Jul 23 03:34:14 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:14 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_atbajxc3" returned: 0 in 0.338s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_atbajxc3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:14 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9 1073741824" returned: 0 in 0.450s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:14 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9 Jul 23 03:34:14 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:14 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_atbajxc3 Jul 23 03:34:14 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:14 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9" returned: 0 in 0.243s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.959s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371576345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dbc10f-2271-4d4b-ac29-d7fd563ee37d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd42e7acb96d42d29ad170f5e8a2ce11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:09Z,use_quota=True,user_id='044535a2da73406782e0bdec1e566249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Creating volume 57dbc10f-2271-4d4b-ac29-d7fd563ee37d {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:14 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:14 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a4d82d-0f09-4224-bc06-23a820069650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3165bd-7865-4bca-8e23-f4e21742adc9', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6208d080-dc66-4158-befd-6982c71bcf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:14 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d 1073741824 Jul 23 03:34:14 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_atbajxc3" returned: 1 in 0.357s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_atbajxc3' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9299e7c9-c008-4fcf-b115-d683bd361a69]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:14 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume volume-ee3165bd-7865-4bca-8e23-f4e21742adc9 (ee3165bd-7865-4bca-8e23-f4e21742adc9): created successfully Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6208d080-dc66-4158-befd-6982c71bcf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (406bbc7c-b2b8-40b0-bd3a-48f9ace95998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:14 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9e335d4c-1395-49ca-8f5c-c81c36fb477d tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created volume successfully. Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "cinder-8cea48b6-8f61-4b07-b237-31bfc5dab468-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-8cea48b6-8f61-4b07-b237-31bfc5dab468-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:14 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD Jul 23 03:34:14 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "cinder-quobyte-8cea48b6-8f61-4b07-b237-31bfc5dab468" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-quobyte-8cea48b6-8f61-4b07-b237-31bfc5dab468" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bb5b31-a4ff-4f32-ae81-e574b299a3c4]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:15 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468 Jul 23 03:34:15 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:15 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:15 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d 1073741824" returned: 0 in 0.467s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:15 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD Jul 23 03:34:15 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:15 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d Jul 23 03:34:15 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:15 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468" returned: 0 in 0.430s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:15 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468 Jul 23 03:34:15 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:15 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:15 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] a2a00c0b-f249-4bf5-92a8-1c0a1de471cd was raw, converting to qcow2 {{(pid=88392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d" returned: 0 in 0.303s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.825s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-421559201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3414d65e-22ff-4536-96f6-a7aa7e91d15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:12Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Creating volume 3414d65e-22ff-4536-96f6-a7aa7e91d15d {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:15 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:15 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb Jul 23 03:34:15 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aabfbe6-7207-48be-8dfd-3b6770a00bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3828942a-0d30-459e-b933-a2d0086d6f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:15 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d 1073741824 Jul 23 03:34:15 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:15 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Volume volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d (57dbc10f-2271-4d4b-ac29-d7fd563ee37d): created successfully Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3828942a-0d30-459e-b933-a2d0086d6f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Flow 'volume_create_manager' (b6846b18-d2eb-4e9e-908a-2d358b467135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-cf683949-b445-49b4-ba3f-725e9ee4b322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created volume successfully. Jul 23 03:34:15 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-8cea48b6-8f61-4b07-b237-31bfc5dab468" returned: 0 in 0.275s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-quobyte-8cea48b6-8f61-4b07-b237-31bfc5dab468" released by "delete_volume" :: held 0.755s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Created reservations ['8dde55d9-551b-445a-a5fb-05553341ef8e', '5c7a20f7-35ea-48e0-acba-b6f548940632', 'ff515f84-8b4c-4225-a0fb-9bd0e7f23b36', '96306d1f-c72e-4f67-9566-dd6ea2294c62'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:15 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:15 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:16 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:16 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d 1073741824" returned: 0 in 0.508s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb" returned: 0 in 0.550s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a2a00c0b-f249-4bf5-92a8-1c0a1de471cd_pmgqpgnhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:34:16 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:16 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb 1G Jul 23 03:34:16 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:16 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d Jul 23 03:34:16 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:16 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.327s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Deleted volume successfully. Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1f9743e7-6f7d-4a4b-b510-6fdc341f1fd2 tempest-CreateVolumesFromImageTest-1451274547 None] Lock "cinder-8cea48b6-8f61-4b07-b237-31bfc5dab468-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:16 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d" returned: 0 in 0.334s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.265s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2124612738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ccd001-2d05-4763-a06c-b7c2d68a3b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:12Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Creating volume 62ccd001-2d05-4763-a06c-b7c2d68a3b1a {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:16 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:16 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb269dff-3c65-45d9-83f4-b2452ee4243a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:16 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a 1073741824 Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8f210c-99d0-4c6a-80ea-8319182dcae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:16 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb 1G" returned: 0 in 0.457s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-57dbc10f-2271-4d4b-ac29-d7fd563ee37d-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Downloaded image a2a00c0b-f249-4bf5-92a8-1c0a1de471cd ((None, [{'url': 'file:///opt/stack/data/glance/images/a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'metadata': {}}])) to volume a8b0b3b7-20d9-448e-97f0-f04587fafbfb successfully. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Temporary image a2a00c0b-f249-4bf5-92a8-1c0a1de471cd for user c0f435fded874a7b8fa4ac4f56fbadeb is deleted. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Marking volume a8b0b3b7-20d9-448e-97f0-f04587fafbfb as bootable. {{(pid=88392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:34:16 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d (3414d65e-22ff-4536-96f6-a7aa7e91d15d): created successfully Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8f210c-99d0-4c6a-80ea-8319182dcae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (e5168148-1150-41ed-b625-6da718637ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Copying metadata from image a2a00c0b-f249-4bf5-92a8-1c0a1de471cd to a8b0b3b7-20d9-448e-97f0-f04587fafbfb. {{(pid=88392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Creating volume glance metadata for volume a8b0b3b7-20d9-448e-97f0-f04587fafbfb backed by image a2a00c0b-f249-4bf5-92a8-1c0a1de471cd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4e8dc03915950e18ddafbbf843e9dced', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-57dbc10f-2271-4d4b-ac29-d7fd563ee37d-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-015ea81f-42f0-4e75-86c2-8d2eab47b023 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created volume successfully. Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-quobyte-57dbc10f-2271-4d4b-ac29-d7fd563ee37d" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-57dbc10f-2271-4d4b-ac29-d7fd563ee37d" acquired by "delete_volume" :: waited 0.033s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab5f0f4-c5b3-48af-b23c-a4ba9689a1a6]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec88acca-3d52-4536-a17a-3886f9ce8850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb', 'volume_size': 1, 'image_id': 'a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4e8dc03915950e18ddafbbf843e9dced', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ede45bed040846ef858880e1759c5b7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '075dcac90d0d3ad920afac3bd77091ba3e59240377e6f2acbd953803b3187e82b981f8c61e020974f9cc96a4ffa618119a171934d893e7eed0b42e490f8a3eef', 'id': 'a2a00c0b-f249-4bf5-92a8-1c0a1de471cd', 'created_at': datetime.datetime(2026, 7, 23, 1, 34, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 34, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2a00c0b-f249-4bf5-92a8-1c0a1de471cd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64230940-811e-44bd-9948-26e406ee5400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:16 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Volume volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb (a8b0b3b7-20d9-448e-97f0-f04587fafbfb): created successfully Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64230940-811e-44bd-9948-26e406ee5400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Flow 'volume_create_manager' (7fd3f485-78ba-4f02-bb80-2e6d30f700a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-103276c2-69c8-480c-a1dd-3332f2ed0185 tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Created volume successfully. Jul 23 03:34:16 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d Jul 23 03:34:16 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:17 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a 1073741824" returned: 0 in 0.600s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:17 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a Jul 23 03:34:17 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:17 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d" returned: 0 in 0.437s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:17 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d Jul 23 03:34:17 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:17 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a" returned: 0 in 0.260s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.764s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493653097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7a3c30-422e-44f6-b25d-79ccdbd0c03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:12Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Creating volume 3a7a3c30-422e-44f6-b25d-79ccdbd0c03a {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:17 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4894bfcb-ed8a-4ea3-b815-fef3174dfab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:17 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a 1073741824 Jul 23 03:34:17 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0023c1b5-2b12-4a53-a9f2-c910e9a73628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:17 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a (62ccd001-2d05-4763-a06c-b7c2d68a3b1a): created successfully Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0023c1b5-2b12-4a53-a9f2-c910e9a73628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:17 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (665c9eff-ef7d-4a7b-8238-ed3d47cfd499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-57dbc10f-2271-4d4b-ac29-d7fd563ee37d" returned: 0 in 0.312s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-57dbc10f-2271-4d4b-ac29-d7fd563ee37d" released by "delete_volume" :: held 0.798s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:17 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-07340eac-6d4d-4604-8a20-261c2e571db9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created volume successfully. Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Acquiring lock "cinder-a8b0b3b7-20d9-448e-97f0-f04587fafbfb-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Lock "cinder-a8b0b3b7-20d9-448e-97f0-f04587fafbfb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created reservations ['e5689fc9-b345-4daa-9450-75aaed9c7a69', '582ea66a-7e0b-4acd-8a9d-76665445f553', 'c5b2f595-e31b-4592-95cf-709074d16e0a', 'c47cbc51-a765-4240-b288-cec9840fc365'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Acquiring lock "cinder-quobyte-a8b0b3b7-20d9-448e-97f0-f04587fafbfb" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Lock "cinder-quobyte-a8b0b3b7-20d9-448e-97f0-f04587fafbfb" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[78046365-d542-4315-afa9-a51a26800c86]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:17 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:17 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:17 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb Jul 23 03:34:17 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:18 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a 1073741824" returned: 0 in 0.650s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:18 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.315s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:18 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Deleted volume successfully. Jul 23 03:34:18 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a Jul 23 03:34:18 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d30b812f-dec2-4130-9217-ae54c8b52351 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-57dbc10f-2271-4d4b-ac29-d7fd563ee37d-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:18 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb" returned: 0 in 0.467s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:18 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb Jul 23 03:34:18 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:18 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a" returned: 0 in 0.301s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.105s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989603314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b05fb7-0cd0-4f19-a920-ea455d4d0f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:13Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Creating volume c6b05fb7-0cd0-4f19-a920-ea455d4d0f64 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:18 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14366d7a-5edb-408d-ad17-db07ff7b0ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b38519e-5933-4e84-b085-4fc4b9966926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:18 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64 1073741824 Jul 23 03:34:18 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:18 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a (3a7a3c30-422e-44f6-b25d-79ccdbd0c03a): created successfully Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b38519e-5933-4e84-b085-4fc4b9966926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (501376b6-51e1-4635-a47e-d4b03d9f3218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:18 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b32446e8-6d87-4630-b303-0817ae81698a tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created volume successfully. Jul 23 03:34:18 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a8b0b3b7-20d9-448e-97f0-f04587fafbfb" returned: 0 in 0.321s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Lock "cinder-quobyte-a8b0b3b7-20d9-448e-97f0-f04587fafbfb" released by "delete_volume" :: held 0.847s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Created reservations ['2c06746b-d425-4ad8-9963-656ed3645251', '77504ef9-9634-4155-9a8c-bc753604d369', '11d8300b-a051-4ecb-815e-29de9777039e', '3e740024-f741-4126-a8d1-7f21ba244b0a'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:18 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:18 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-ee3165bd-7865-4bca-8e23-f4e21742adc9-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-ee3165bd-7865-4bca-8e23-f4e21742adc9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-quobyte-ee3165bd-7865-4bca-8e23-f4e21742adc9" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-ee3165bd-7865-4bca-8e23-f4e21742adc9" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[85613dc0-776f-4b27-9eca-83df84690d5d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:19 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64 1073741824" returned: 0 in 0.667s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:19 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.410s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:19 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Deleted volume successfully. Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ca2a63fd-64a9-44ab-8be6-1c9855f798fa tempest-VolumeAndVolumeTypeFromImageTest-936553071 None] Lock "cinder-a8b0b3b7-20d9-448e-97f0-f04587fafbfb-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:19 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9 Jul 23 03:34:19 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64 Jul 23 03:34:19 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:19 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:19 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64" returned: 0 in 0.289s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.807s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809248585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77fae4a5-87a4-4d45-a617-b09cacc992f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3579275346824fa18d1e8a95956dba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:14Z,use_quota=True,user_id='02aa7a8b5ddd4b7ab446702c2564665d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Creating volume 77fae4a5-87a4-4d45-a617-b09cacc992f7 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:19 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e7dd1a-c1aa-4d25-ac28-1c0f0bb2cc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:19 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7 1073741824 Jul 23 03:34:19 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f89c2a7-4f32-4807-91ee-519ba6d30fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:19 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9" returned: 0 in 0.535s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:19 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64 (c6b05fb7-0cd0-4f19-a920-ea455d4d0f64): created successfully Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f89c2a7-4f32-4807-91ee-519ba6d30fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:19 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9 Jul 23 03:34:19 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (e8a6e747-3e88-4403-8e72-3eab7eacdd47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:19 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5eb7d702-8f06-4d8b-8e5e-37d599b608b9 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created volume successfully. Jul 23 03:34:19 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-ee3165bd-7865-4bca-8e23-f4e21742adc9" returned: 0 in 0.363s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-ee3165bd-7865-4bca-8e23-f4e21742adc9" released by "delete_volume" :: held 0.964s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Flow 'volume_create_manager' (099937c3-de62-42fd-984c-a9698d457054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b9c2a4-6b77-49c7-8604-6d2cbf79571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b9c2a4-6b77-49c7-8604-6d2cbf79571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89645f8f-2100-49f6-8fd5-e17da38dabc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c704d91227e64dd79b3c293178701cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:20Z,use_quota=True,user_id='9e47cc38071f4fd7b80bebf6dde81897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f999c7-b296-491a-84ed-31840dd4aa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f999c7-b296-491a-84ed-31840dd4aa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecfea94-feef-4bb0-b15b-dba46c0a1274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecfea94-feef-4bb0-b15b-dba46c0a1274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89645f8f-2100-49f6-8fd5-e17da38dabc0', 'volume_name': 'volume-89645f8f-2100-49f6-8fd5-e17da38dabc0', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccf2810-fd70-4d4f-9532-107b82bec1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccf2810-fd70-4d4f-9532-107b82bec1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f4fce3-f633-4b01-80de-25215698fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:20 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Volume 89645f8f-2100-49f6-8fd5-e17da38dabc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89645f8f-2100-49f6-8fd5-e17da38dabc0', 'volume_size': 1} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created reservations ['56fe57e6-4c6f-4c24-b1ab-eabe16ebb0ae', '7809d274-4719-46e8-9bbd-b247c69a5d7b', '7b4ad722-5e0b-42db-a285-512c4c3dd388', 'f0929c6c-fa72-44b1-a8b4-5ed005747436'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:20 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7 1073741824" returned: 0 in 0.683s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:20 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:20 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:20 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7 Jul 23 03:34:20 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:20 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7" returned: 0 in 0.294s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89645f8f-2100-49f6-8fd5-e17da38dabc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c704d91227e64dd79b3c293178701cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:20Z,use_quota=True,user_id='9e47cc38071f4fd7b80bebf6dde81897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Creating volume 89645f8f-2100-49f6-8fd5-e17da38dabc0 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:20 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:20 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.387s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b67ca22-8aa8-4c65-a46b-a9e661da915f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77fae4a5-87a4-4d45-a617-b09cacc992f7', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:20 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0 1073741824 Jul 23 03:34:20 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8993ae8-2ffd-4b10-819c-062905b4e4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:20 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Deleted volume successfully. Jul 23 03:34:20 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Volume volume-77fae4a5-87a4-4d45-a617-b09cacc992f7 (77fae4a5-87a4-4d45-a617-b09cacc992f7): created successfully Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8993ae8-2ffd-4b10-819c-062905b4e4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Flow 'volume_create_manager' (a75a2984-bf7f-44e0-a4a1-865862cbea5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:20 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1b4a486f-1659-4c54-99cf-37253d9343d4 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-ee3165bd-7865-4bca-8e23-f4e21742adc9-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:20 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0b29c15c-d28c-4d6d-928f-a888f4ee376f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created volume successfully. Jul 23 03:34:21 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0 1073741824" returned: 0 in 0.542s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-f2820b09-c06f-4d82-8745-be75b0086fda-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:21 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0 Jul 23 03:34:21 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-f2820b09-c06f-4d82-8745-be75b0086fda-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-quobyte-f2820b09-c06f-4d82-8745-be75b0086fda" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-f2820b09-c06f-4d82-8745-be75b0086fda" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8a7680-b460-428c-a9a2-147f3ebc9edd]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-77fae4a5-87a4-4d45-a617-b09cacc992f7-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-77fae4a5-87a4-4d45-a617-b09cacc992f7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:21 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0" returned: 0 in 0.344s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:21 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda Jul 23 03:34:21 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f4fce3-f633-4b01-80de-25215698fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89645f8f-2100-49f6-8fd5-e17da38dabc0', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46946557-451a-4944-bfab-a9b18b58f959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-quobyte-77fae4a5-87a4-4d45-a617-b09cacc992f7" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:21 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Volume volume-89645f8f-2100-49f6-8fd5-e17da38dabc0 (89645f8f-2100-49f6-8fd5-e17da38dabc0): created successfully Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46946557-451a-4944-bfab-a9b18b58f959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Flow 'volume_create_manager' (099937c3-de62-42fd-984c-a9698d457054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-77fae4a5-87a4-4d45-a617-b09cacc992f7" acquired by "delete_volume" :: waited 0.043s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:21 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-977d2d68-db53-4830-8698-4eab21a0cef2 tempest-CinderUnicodeTest-1665007183 None] Created volume successfully. Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8b3dd8-8f24-495e-ba79-75828e64651e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:21 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7 Jul 23 03:34:21 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:21 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda" returned: 0 in 0.493s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:21 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda Jul 23 03:34:21 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:22 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7" returned: 0 in 0.471s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:22 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:22 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7 Jul 23 03:34:22 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f2820b09-c06f-4d82-8745-be75b0086fda" returned: 0 in 0.307s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-f2820b09-c06f-4d82-8745-be75b0086fda" released by "delete_volume" :: held 0.886s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created reservations ['8af2b75e-7ec8-4df6-bb7a-35503a6deffe', 'e2250a10-ef7f-4b8b-9e45-d6e19bef4a71', '56530cce-882f-467b-a795-a0142dc16523', '6f81ffe4-40e0-4e2d-8b87-df16cd125c7c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:22 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-77fae4a5-87a4-4d45-a617-b09cacc992f7" returned: 0 in 0.358s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:22 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:22 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-a6970246-8ce9-4999-948b-0ff5a0f7c7a0-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-77fae4a5-87a4-4d45-a617-b09cacc992f7" released by "delete_volume" :: held 0.923s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-a6970246-8ce9-4999-948b-0ff5a0f7c7a0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-quobyte-a6970246-8ce9-4999-948b-0ff5a0f7c7a0" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-a6970246-8ce9-4999-948b-0ff5a0f7c7a0" acquired by "delete_volume" :: waited 0.037s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created reservations ['2cd59957-edcd-4fef-98a6-8a848f765963', '8764480c-68fe-455e-b9b8-4ca1fe49a429', 'b81f694e-b241-4c26-adc6-5fc2bb1618a1', '32fd579c-f3ea-4015-9510-72e1b43f7129'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bc304a-c38f-477c-98dc-a99f4cfba379]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:22 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:22 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:22 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.464s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:22 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Deleted volume successfully. Jul 23 03:34:22 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0 Jul 23 03:34:22 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b9fa4ce7-ce38-4d41-bfbc-2f7cf5ef1322 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-f2820b09-c06f-4d82-8745-be75b0086fda-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Flow 'volume_create_manager' (0806d664-acde-4376-8110-114177ad4e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d6ba78-0594-4109-b910-f0bd78979290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d6ba78-0594-4109-b910-f0bd78979290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-318177239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764d1ce5-e593-44db-9707-53d59133f9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c704d91227e64dd79b3c293178701cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:23Z,use_quota=True,user_id='9e47cc38071f4fd7b80bebf6dde81897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8449f19b-e9c4-4274-999e-9f50a8e3ee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8449f19b-e9c4-4274-999e-9f50a8e3ee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37c15f9-94ab-433b-8170-9da66f4bb88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37c15f9-94ab-433b-8170-9da66f4bb88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '764d1ce5-e593-44db-9707-53d59133f9eb', 'volume_name': 'volume-764d1ce5-e593-44db-9707-53d59133f9eb', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62365a23-f2ae-4592-b573-3c62d23c5256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62365a23-f2ae-4592-b573-3c62d23c5256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da063d7-9ee8-4420-a264-c09c63543140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:23 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Volume 764d1ce5-e593-44db-9707-53d59133f9eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-764d1ce5-e593-44db-9707-53d59133f9eb', 'volume_size': 1} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-318177239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764d1ce5-e593-44db-9707-53d59133f9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c704d91227e64dd79b3c293178701cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:23Z,use_quota=True,user_id='9e47cc38071f4fd7b80bebf6dde81897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Creating volume 764d1ce5-e593-44db-9707-53d59133f9eb {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:23 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:23 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.345s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Deleted volume successfully. Jul 23 03:34:23 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb 1073741824 Jul 23 03:34:23 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-29277d92-3c85-40c6-bebc-dee3a103aa78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-77fae4a5-87a4-4d45-a617-b09cacc992f7-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:23 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0" returned: 0 in 0.501s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:23 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0 Jul 23 03:34:23 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:23 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a6970246-8ce9-4999-948b-0ff5a0f7c7a0" returned: 0 in 0.300s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-a6970246-8ce9-4999-948b-0ff5a0f7c7a0" released by "delete_volume" :: held 0.884s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created reservations ['83c2a863-a5e7-4584-a654-a59549b7fb9d', 'e6c2cb63-58da-43a7-9332-4c8b2aaaf6bf', 'a2dbe238-f270-4bee-9592-2e2d3a041e20', 'ee7bf6fd-400d-4e80-830b-95d7e2bedbfd'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:23 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb 1073741824" returned: 0 in 0.595s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:23 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:23 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:23 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb Jul 23 03:34:23 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:24 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.295s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:24 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Deleted volume successfully. Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f7fae356-8e53-437a-b0a4-73e804f2065f tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-a6970246-8ce9-4999-948b-0ff5a0f7c7a0-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-quobyte-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64" acquired by "delete_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:24 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb" returned: 0 in 0.419s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da063d7-9ee8-4420-a264-c09c63543140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-764d1ce5-e593-44db-9707-53d59133f9eb', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca95211-4397-4d8c-a357-a2d1ec2b6430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72ea712-fca2-44c6-833f-ed4f655d4bd8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:24 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Volume volume-764d1ce5-e593-44db-9707-53d59133f9eb (764d1ce5-e593-44db-9707-53d59133f9eb): created successfully Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca95211-4397-4d8c-a357-a2d1ec2b6430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Flow 'volume_create_manager' (0806d664-acde-4376-8110-114177ad4e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:24 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-911eac69-5df8-4a42-bc19-6cc699176e80 tempest-CinderUnicodeTest-1665007183 None] Created volume successfully. Jul 23 03:34:24 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64 Jul 23 03:34:24 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:24 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64" returned: 0 in 0.367s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:24 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64 Jul 23 03:34:24 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-702c8b78-a04a-4669-b8cd-e7b3ac39c32c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:24 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-702c8b78-a04a-4669-b8cd-e7b3ac39c32c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64" returned: 0 in 0.263s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64" released by "delete_volume" :: held 0.705s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-quobyte-702c8b78-a04a-4669-b8cd-e7b3ac39c32c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-702c8b78-a04a-4669-b8cd-e7b3ac39c32c" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2460d9ce-8874-4e43-986c-6d60befa0933]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created reservations ['466202d0-6517-415d-8186-1161526318d1', '31da899b-df12-4968-906d-ee9eeec47ffe', '124fed41-068b-4c5d-bdd4-126292a50523', '6d862462-4142-4640-bcf9-829dab46064c'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:25 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c Jul 23 03:34:25 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:25 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:25 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Flow 'volume_create_manager' (b8db159f-cdb6-466a-af8b-07e9656b6cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535564b4-5cee-4725-86c3-86b549780645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535564b4-5cee-4725-86c3-86b549780645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-821282780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89a45a5-ede4-4353-a431-1267c439d6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fa428f6cbe4cde82a4a92881320b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:25Z,use_quota=True,user_id='0617e26fccaf4afcbeff0fac8b91f1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d4813a-635f-4eac-a348-85fed0c47187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d4813a-635f-4eac-a348-85fed0c47187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4c6e3f-c62b-4774-b166-f7a469cefa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4c6e3f-c62b-4774-b166-f7a469cefa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd89a45a5-ede4-4353-a431-1267c439d6df', 'volume_name': 'volume-d89a45a5-ede4-4353-a431-1267c439d6df', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3c9fc0-63e3-4701-8b11-c86b790642fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3c9fc0-63e3-4701-8b11-c86b790642fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65226973-4dab-4aa7-9c84-33a455112303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:25 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Volume d89a45a5-ede4-4353-a431-1267c439d6df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d89a45a5-ede4-4353-a431-1267c439d6df', 'volume_size': 1} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-821282780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89a45a5-ede4-4353-a431-1267c439d6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fa428f6cbe4cde82a4a92881320b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:25Z,use_quota=True,user_id='0617e26fccaf4afcbeff0fac8b91f1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Creating volume d89a45a5-ede4-4353-a431-1267c439d6df {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:25 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:25 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-quobyte-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.438s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:25 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df 1073741824 Jul 23 03:34:25 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:25 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Deleted volume successfully. Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c" returned: 0 in 0.615s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[460ac2e2-9537-49b3-8492-ce35a1f62376]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:25 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c Jul 23 03:34:25 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-99eecbef-f164-46bf-8642-19ba0d7ff070 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-c6b05fb7-0cd0-4f19-a920-ea455d4d0f64-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:25 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a Jul 23 03:34:25 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:25 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-702c8b78-a04a-4669-b8cd-e7b3ac39c32c" returned: 0 in 0.287s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-702c8b78-a04a-4669-b8cd-e7b3ac39c32c" released by "delete_volume" :: held 0.957s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:25 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created reservations ['e66627c9-96e6-4e56-aa72-ebaefbe4fe35', '0fc375df-1fbc-4cb9-8b1a-90bd53283c7a', 'c4ac482a-2d78-4a0f-8d41-5129ade7941a', 'b4ab0add-5eee-4d74-a1e0-b2fcacd9e17b'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:26 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:26 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a" returned: 0 in 0.425s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df 1073741824" returned: 0 in 0.534s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:26 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:26 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:26 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a Jul 23 03:34:26 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:26 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df Jul 23 03:34:26 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:26 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.297s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:26 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Deleted volume successfully. Jul 23 03:34:26 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a" returned: 0 in 0.322s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:26 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df" returned: 0 in 0.288s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.733s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a" released by "delete_volume" :: held 0.825s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] Creating offline snapshot 0f31eecb-d49d-4c1b-8713-f741745d9ba6 of volume 764d1ce5-e593-44db-9707-53d59133f9eb {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d96bb63f-26af-42cc-89a3-cf18d1fcb11b tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-702c8b78-a04a-4669-b8cd-e7b3ac39c32c-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65226973-4dab-4aa7-9c84-33a455112303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d89a45a5-ede4-4353-a431-1267c439d6df', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb54515-5e38-4e7f-b778-04c81a4e1cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcda8fb-4fb5-4322-a135-86e603e5cf22]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:26 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Volume volume-d89a45a5-ede4-4353-a431-1267c439d6df (d89a45a5-ede4-4353-a431-1267c439d6df): created successfully Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb54515-5e38-4e7f-b778-04c81a4e1cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Flow 'volume_create_manager' (b8db159f-cdb6-466a-af8b-07e9656b6cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:26 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e6fb6a98-8bbb-49a2-95d8-f6b98a9c8713 tempest-ProjectReaderTests-1070529529 None] Created volume successfully. Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created reservations ['6c72964d-2def-494f-9dfd-bbb1f31ba5a5', '87a333da-8c3a-4519-a531-2c0cb5a0e982', '8077c12e-bf0b-429f-9f6c-03966cc044fb', 'f0d205fb-87ec-4590-b599-2a45540aead1'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:26 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb Jul 23 03:34:26 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:26 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:26 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:26 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb" returned: 0 in 0.415s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:26 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 1G Jul 23 03:34:26 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:26 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.252s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:26 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Deleted volume successfully. Jul 23 03:34:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-4476934c-2ab4-4274-9891-a9c4840b5e80 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-3a7a3c30-422e-44f6-b25d-79ccdbd0c03a-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-4c04b9d0-5557-47ec-a28f-a9a0e299812a-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-4c04b9d0-5557-47ec-a28f-a9a0e299812a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "cinder-quobyte-4c04b9d0-5557-47ec-a28f-a9a0e299812a" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-4c04b9d0-5557-47ec-a28f-a9a0e299812a" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2e1a67-c948-46b3-8f5c-36a13cbf07c2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:27 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a Jul 23 03:34:27 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:27 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 1G" returned: 0 in 0.480s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764d1ce5-e593-44db-9707-53d59133f9eb -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:27 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764d1ce5-e593-44db-9707-53d59133f9eb -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 Jul 23 03:34:27 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:27 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a" returned: 0 in 0.454s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-62ccd001-2d05-4763-a06c-b7c2d68a3b1a-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:27 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a Jul 23 03:34:27 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-62ccd001-2d05-4763-a06c-b7c2d68a3b1a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-quobyte-62ccd001-2d05-4763-a06c-b7c2d68a3b1a" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-62ccd001-2d05-4763-a06c-b7c2d68a3b1a" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:27 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764d1ce5-e593-44db-9707-53d59133f9eb -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6" returned: 0 in 0.389s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:27 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 is being set with open permissions: ugo+rw Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[417b139e-896c-4c95-920e-2f19c4d431d4]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:27 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 Jul 23 03:34:27 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:27 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a Jul 23 03:34:27 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:27 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-4c04b9d0-5557-47ec-a28f-a9a0e299812a" returned: 0 in 0.289s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-quobyte-4c04b9d0-5557-47ec-a28f-a9a0e299812a" released by "delete_volume" :: held 0.789s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Created reservations ['a411fb26-9bcc-4318-a079-ea20a96604e2', '667042e7-eb44-4b8c-94a5-4d8057010f51', 'c69a2cca-81a4-4cc7-b354-2a01449ac764', '129ce447-3129-4319-84bd-6b02dce0de65'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:28 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6" returned: 0 in 0.247s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:28 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.info Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:28 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:28 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:28 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:28 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a" returned: 0 in 0.386s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:28 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a Jul 23 03:34:28 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:28 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.info" returned: 0 in 0.301s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:28 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.info is being set with open permissions: ugo+rw Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:28 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.290s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:28 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.info Jul 23 03:34:28 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:28 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Deleted volume successfully. Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9bc879b3-e7dc-4942-a8bd-2b5ed15a11a7 tempest-CreateVolumesFromSourceVolumeTest-1861811690 None] Lock "cinder-4c04b9d0-5557-47ec-a28f-a9a0e299812a-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:28 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-62ccd001-2d05-4763-a06c-b7c2d68a3b1a" returned: 0 in 0.294s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-62ccd001-2d05-4763-a06c-b7c2d68a3b1a" released by "delete_volume" :: held 0.728s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created reservations ['db263b42-9e8a-4082-be7b-fe81dd069cdc', '1203ffc8-aa08-44a5-ad53-a9eb0ca2efe9', '72f0d68b-bcda-4c09-961c-92927a9a8b29', '43bf29b4-91cc-43b1-a290-bc496f91f136'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:28 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:28 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:28 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.info" returned: 0 in 0.286s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.121s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] Creating offline snapshot 7b188550-265f-4ace-8a64-832a46ec3883 of volume d89a45a5-ede4-4353-a431-1267c439d6df {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:34:28 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-50c26954-6bc8-4226-8575-6aee9c03c007 tempest-CinderUnicodeTest-1665007183 None] Create snapshot completed successfully Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7494a6-e4ce-46b9-8638-810f6bcb5500]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-3414d65e-22ff-4536-96f6-a7aa7e91d15d-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "cinder-0f31eecb-d49d-4c1b-8713-f741745d9ba6-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:28 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df Jul 23 03:34:28 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:28 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-3414d65e-22ff-4536-96f6-a7aa7e91d15d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.328s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-0f31eecb-d49d-4c1b-8713-f741745d9ba6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "cinder-quobyte-764d1ce5-e593-44db-9707-53d59133f9eb" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:28 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Deleted volume successfully. Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-quobyte-764d1ce5-e593-44db-9707-53d59133f9eb" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "cinder-quobyte-0f31eecb-d49d-4c1b-8713-f741745d9ba6" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6a331a01-a103-40ff-8e8c-7f0c771dbc44 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-62ccd001-2d05-4763-a06c-b7c2d68a3b1a-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-quobyte-3414d65e-22ff-4536-96f6-a7aa7e91d15d" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-quobyte-0f31eecb-d49d-4c1b-8713-f741745d9ba6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Deleting offline snapshot 0f31eecb-d49d-4c1b-8713-f741745d9ba6 of volume 764d1ce5-e593-44db-9707-53d59133f9eb {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] snapshot_file for this snap is: volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-3414d65e-22ff-4536-96f6-a7aa7e91d15d" acquired by "delete_volume" :: waited 0.047s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[816dead6-6626-4ed6-9b6f-63b94fe89f48]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55a07b0-50f0-4b4f-a553-3525f13cbd1e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:29 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 Jul 23 03:34:29 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:29 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:29 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d Jul 23 03:34:29 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df" returned: 0 in 0.537s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:29 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 1G Jul 23 03:34:29 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:29 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6" returned: 0 in 0.495s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-764d1ce5-e593-44db-9707-53d59133f9eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:34:29 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d" returned: 0 in 0.523s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ac7388-47b0-464f-a4fd-8b6363b89834]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:29 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d Jul 23 03:34:29 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:29 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb Jul 23 03:34:29 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:29 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 1G" returned: 0 in 0.559s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d89a45a5-ede4-4353-a431-1267c439d6df -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:29 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d89a45a5-ede4-4353-a431-1267c439d6df -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 Jul 23 03:34:29 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:30 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3414d65e-22ff-4536-96f6-a7aa7e91d15d" returned: 0 in 0.356s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-3414d65e-22ff-4536-96f6-a7aa7e91d15d" released by "delete_volume" :: held 0.937s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created reservations ['3711c974-3bab-4022-907e-63554dff0a99', 'e7c34c0e-c623-4138-ad31-ea82bc5cfde3', '61737aa8-429e-4780-9555-454028729e96', 'f583b586-4a4a-4d60-8268-3fa34db43cc6'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:30 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb" returned: 0 in 0.510s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:30 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 Jul 23 03:34:30 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:30 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d89a45a5-ede4-4353-a431-1267c439d6df -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883" returned: 0 in 0.403s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:30 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 is being set with open permissions: ugo+rw Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:30 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:30 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:30 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 Jul 23 03:34:30 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:30 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.315s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Deleted volume successfully. Jul 23 03:34:30 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883" returned: 0 in 0.330s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-45d37bf8-94d3-450e-b97a-8f5d870eef7f tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-3414d65e-22ff-4536-96f6-a7aa7e91d15d-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:30 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.info Jul 23 03:34:30 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:30 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6" returned: 0 in 0.552s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:30 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6 Jul 23 03:34:30 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:30 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.info" returned: 0 in 0.334s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:30 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.info is being set with open permissions: ugo+rw Jul 23 03:34:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:30 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.info Jul 23 03:34:30 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:31 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb.0f31eecb-d49d-4c1b-8713-f741745d9ba6" returned: 0 in 0.321s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-quobyte-0f31eecb-d49d-4c1b-8713-f741745d9ba6" released by "_delete_snapshot" :: held 2.038s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-quobyte-764d1ce5-e593-44db-9707-53d59133f9eb" released by "delete_snapshot" :: held 2.073s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Created reservations ['ee345ee2-bb28-4b40-b375-b08d17c3a8fa', '6a3800e0-c259-4c44-8794-52b64c06acd7', 'c8e5bfb0-ebe5-43fa-bcf9-6a13782e70ff', '41cf3cdc-3cb3-4ebf-94c2-6d3755e02821'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-9881e132-5826-44bc-9bd0-8eb1045c4a4a-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:31 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.info" returned: 0 in 0.281s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.566s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-9881e132-5826-44bc-9bd0-8eb1045c4a4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-quobyte-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-quobyte-9881e132-5826-44bc-9bd0-8eb1045c4a4a" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:31 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-78807755-ce53-4ddd-8eb6-7facb94642ff tempest-ProjectReaderTests-1070529529 None] Create snapshot completed successfully Jul 23 03:34:31 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Delete snapshot completed successfully. Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-9881e132-5826-44bc-9bd0-8eb1045c4a4a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Deleting offline snapshot 9881e132-5826-44bc-9bd0-8eb1045c4a4a of volume f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] snapshot_file for this snap is: volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-60db8707-425b-47be-9600-f45e83415c82 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-0f31eecb-d49d-4c1b-8713-f741745d9ba6-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8c6b84-731a-4a57-aa85-ba7eeea8a6b7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:31 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a Jul 23 03:34:31 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:31 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a" returned: 0 in 0.430s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3cb2c8-3baa-45a4-b576-99c81a75f21c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:31 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 Jul 23 03:34:31 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-7b188550-265f-4ace-8a64-832a46ec3883-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Lock "cinder-7b188550-265f-4ace-8a64-832a46ec3883-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-d89a45a5-ede4-4353-a431-1267c439d6df" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-d89a45a5-ede4-4353-a431-1267c439d6df" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-7b188550-265f-4ace-8a64-832a46ec3883" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-7b188550-265f-4ace-8a64-832a46ec3883" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Deleting offline snapshot 7b188550-265f-4ace-8a64-832a46ec3883 of volume d89a45a5-ede4-4353-a431-1267c439d6df {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] snapshot_file for this snap is: volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f964f2-4146-412d-b574-2b4972982b25]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "cinder-764d1ce5-e593-44db-9707-53d59133f9eb-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-764d1ce5-e593-44db-9707-53d59133f9eb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "cinder-quobyte-764d1ce5-e593-44db-9707-53d59133f9eb" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:32 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-quobyte-764d1ce5-e593-44db-9707-53d59133f9eb" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3" returned: 0 in 0.454s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:32 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 Jul 23 03:34:32 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0d3178-4f47-4b6e-99e9-276894adaa32]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:32 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a Jul 23 03:34:32 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:32 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb Jul 23 03:34:32 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:32 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883" returned: 0 in 0.461s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d89a45a5-ede4-4353-a431-1267c439d6df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cedd7b4-0f60-4534-91f9-6f55c70d412d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:32 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb" returned: 0 in 0.389s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:32 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a" returned: 0 in 0.422s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:32 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb Jul 23 03:34:32 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:32 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df Jul 23 03:34:32 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:32 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a Jul 23 03:34:32 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:32 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3.9881e132-5826-44bc-9bd0-8eb1045c4a4a" returned: 0 in 0.284s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:33 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:33 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-764d1ce5-e593-44db-9707-53d59133f9eb" returned: 0 in 0.343s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df" returned: 0 in 0.417s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-9881e132-5826-44bc-9bd0-8eb1045c4a4a" released by "_delete_snapshot" :: held 1.748s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-quobyte-764d1ce5-e593-44db-9707-53d59133f9eb" released by "delete_volume" :: held 0.822s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3" released by "delete_snapshot" :: held 1.785s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:33 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 Jul 23 03:34:33 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Created reservations ['e013ee5e-5004-4e9e-8959-78cb0634ab28', '29705115-bc0a-4f21-9ee4-c178d7eae568', '1ed7a99c-8ebb-4a88-a6e2-badc9a3a89b2', 'a4883f02-05f8-4d85-a943-538f27122cf8'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created reservations ['ea04bcf4-0da3-4964-ab95-c6525d466244', '475e4ba5-adea-4562-8cc2-eadc92009a09', 'a8d31f10-829f-48c3-bc0c-7a4781afd2cc', '92dcf4d1-17f5-4d0e-819b-cfb04f6c5a0d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:33 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Delete snapshot completed successfully. Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8260c0fb-0229-4b07-af8e-4e7b34da3e95 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-9881e132-5826-44bc-9bd0-8eb1045c4a4a-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:33 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:33 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:33 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883" returned: 0 in 0.487s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:33 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883 Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "cinder-quobyte-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:33 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:33 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.376s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:33 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Deleted volume successfully. Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7fa0cb-1d03-48c3-88b8-7a1ec27689ec]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8e3ef6c8-2016-4fe7-b4cb-9a69fa2b4f57 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-764d1ce5-e593-44db-9707-53d59133f9eb-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "cinder-89645f8f-2100-49f6-8fd5-e17da38dabc0-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-89645f8f-2100-49f6-8fd5-e17da38dabc0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "cinder-quobyte-89645f8f-2100-49f6-8fd5-e17da38dabc0" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:33 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-quobyte-89645f8f-2100-49f6-8fd5-e17da38dabc0" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:33 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c090c9-5523-4d78-b775-1f1d76d9e703]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:33 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df.7b188550-265f-4ace-8a64-832a46ec3883" returned: 0 in 0.373s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-7b188550-265f-4ace-8a64-832a46ec3883" released by "_delete_snapshot" :: held 1.871s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:33 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-d89a45a5-ede4-4353-a431-1267c439d6df" released by "delete_snapshot" :: held 1.906s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:34 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0 Jul 23 03:34:34 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Created reservations ['5f77122e-46b8-49c7-8848-0e70d0cc4d97', 'e2900c02-2e95-4a85-a8da-5ebb8dd61ae9', '9cdd843d-d727-430e-a50f-9367293b00bc', '78c09460-25f4-4c1d-9b79-9da4537720c4'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:34 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Delete snapshot completed successfully. Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-27de8c12-5b3e-4507-8f25-d4ef79582dfc tempest-ProjectReaderTests-1070529529 None] Lock "cinder-7b188550-265f-4ace-8a64-832a46ec3883-delete_snapshot" released by "delete_snapshot" :: held 2.102s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:34 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3" returned: 0 in 0.492s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:34 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3 Jul 23 03:34:34 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-d89a45a5-ede4-4353-a431-1267c439d6df-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-d89a45a5-ede4-4353-a431-1267c439d6df-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-d89a45a5-ede4-4353-a431-1267c439d6df" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:34 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-d89a45a5-ede4-4353-a431-1267c439d6df" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0" returned: 0 in 0.520s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f474b1a-dcaa-41f4-bafd-f17f138d7f34]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:34 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0 Jul 23 03:34:34 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:34 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3" returned: 0 in 0.315s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-quobyte-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3" released by "delete_volume" :: held 0.906s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:34 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df Jul 23 03:34:34 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Created reservations ['95de5358-ccef-4f7a-94a0-e733f4e1a540', '123fe57a-4a6b-4d06-acdb-4e25756ad4f5', '95e628f2-bf9f-4cc0-a090-f07c95aedbc6', '4e91a01f-9b34-41ce-880b-a4ca5beeffc6'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:34 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-89645f8f-2100-49f6-8fd5-e17da38dabc0" returned: 0 in 0.318s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-quobyte-89645f8f-2100-49f6-8fd5-e17da38dabc0" released by "delete_volume" :: held 0.908s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:34 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:34 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Created reservations ['15c0819e-5797-45bd-895e-4fba1bbdc419', '7033e07b-081e-4007-9950-476846a6a23e', 'a1bbbb5e-f4a8-4faa-ba96-68bd8a041b02', 'b4954481-4272-4951-9c6f-ec31bd3bd551'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:34 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:34 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:35 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df" returned: 0 in 0.600s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:35 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df Jul 23 03:34:35 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:35 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.331s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:35 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Deleted volume successfully. Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-07edcbb0-066f-4eea-93c1-ab397e21bb78 tempest-CreateVolumesFromSnapshotTest-1203340351 None] Lock "cinder-f75163ca-c24f-4ef4-b4ec-c6f73b320ea3-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Flow 'volume_create_manager' (96d786d2-90b8-4510-9d66-e6e0b0f7b3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72192dfa-13bf-4d26-bf33-137fb9d91fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72192dfa-13bf-4d26-bf33-137fb9d91fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b53f368-84ff-4874-b384-f251838b044e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d09486d39f84300a6297a4f37073560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:35Z,use_quota=True,user_id='13f6b1f7d2dc449ea35e083177cbd704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4c8a07-cfe2-497c-8fea-3333ee6554ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4c8a07-cfe2-497c-8fea-3333ee6554ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940d5741-a742-4c2c-8e1f-c06eeafe4d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.image.glance [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Creating Keystone auth plugin from conf {{(pid=88392) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 03:34:35 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.360s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:35 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Deleted volume successfully. Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ce1cd7a5-3fbe-4738-9f18-a95e01bd44c6 tempest-CinderUnicodeTest-1665007183 None] Lock "cinder-89645f8f-2100-49f6-8fd5-e17da38dabc0-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:35 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-d89a45a5-ede4-4353-a431-1267c439d6df" returned: 0 in 0.393s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-d89a45a5-ede4-4353-a431-1267c439d6df" released by "delete_volume" :: held 1.093s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Created reservations ['3c64a7aa-fc36-4167-aa70-3817319ac02c', '35eb9572-c129-47ee-a1c2-34b88238139b', 'd0f38abc-79b5-442c-b2d1-5cdb0cf8f802', 'f9c593ea-37f2-4feb-9ce2-a54ff0bf2755'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:35 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:35 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940d5741-a742-4c2c-8e1f-c06eeafe4d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b53f368-84ff-4874-b384-f251838b044e', 'volume_name': 'volume-6b53f368-84ff-4874-b384-f251838b044e', 'volume_size': 1, 'image_id': '9378c37c-5acf-4706-ae39-467792825dbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9378c37c-5acf-4706-ae39-467792825dbf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '723c71a0b4213dafb4fe86f136d91760', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d09486d39f84300a6297a4f37073560', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '32de51f25ae95fec2b092fb1ab31191b40d7cfb2e75f5741e057fa12b4e8b6e7e31faac93ee9aafa261f21f91519d1533404792d9cc781c5503fc4fb9cc51cb6', 'id': '9378c37c-5acf-4706-ae39-467792825dbf', 'created_at': datetime.datetime(2026, 7, 23, 1, 34, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 34, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9378c37c-5acf-4706-ae39-467792825dbf/file', 'properties': {}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50a4867-77c9-439d-b83d-e5d1d085603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50a4867-77c9-439d-b83d-e5d1d085603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4237dc67-af53-4fa0-be88-d352760f24bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:35 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Volume 6b53f368-84ff-4874-b384-f251838b044e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b53f368-84ff-4874-b384-f251838b044e', 'volume_size': 1, 'image_id': '9378c37c-5acf-4706-ae39-467792825dbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9378c37c-5acf-4706-ae39-467792825dbf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '723c71a0b4213dafb4fe86f136d91760', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d09486d39f84300a6297a4f37073560', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '32de51f25ae95fec2b092fb1ab31191b40d7cfb2e75f5741e057fa12b4e8b6e7e31faac93ee9aafa261f21f91519d1533404792d9cc781c5503fc4fb9cc51cb6', 'id': '9378c37c-5acf-4706-ae39-467792825dbf', 'created_at': datetime.datetime(2026, 7, 23, 1, 34, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 34, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9378c37c-5acf-4706-ae39-467792825dbf/file', 'properties': {}}, 'image_service': } Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Trying to clone 6b53f368-84ff-4874-b384-f251838b044e from image 9378c37c-5acf-4706-ae39-467792825dbf at location (None, [{'url': 'file:///opt/stack/data/glance/images/9378c37c-5acf-4706-ae39-467792825dbf', 'metadata': {}}]). {{(pid=88392) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 03:34:35 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Image download 0.00 MB at 0.00 MB/s Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[8360cbc5-0cfa-40f1-9e01-c648cd1b0509]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:35 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.319s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:35 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Deleted volume successfully. Jul 23 03:34:35 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-d161dc1f-6743-46f8-ab88-17904e144b00 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-d89a45a5-ede4-4353-a431-1267c439d6df-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:36 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD Jul 23 03:34:36 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:36 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD" returned: 0 in 0.464s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:36 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD Jul 23 03:34:36 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:36 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD" returned: 1 in 0.480s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:36 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Temporary image 9378c37c-5acf-4706-ae39-467792825dbf is fetched for user 13f6b1f7d2dc449ea35e083177cbd704. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 03:34:36 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[29de391b-ee73-4431-86aa-0a03b88f3586]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:37 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD Jul 23 03:34:37 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Flow 'volume_create_manager' (c01a2df5-d55c-4c8a-8694-fc3bbff65808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75e94c2-3c69-43fb-887e-36c3089ed615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75e94c2-3c69-43fb-887e-36c3089ed615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1827551311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24a49cd-87dd-457f-91a3-35927f1ecfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fa428f6cbe4cde82a4a92881320b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:37Z,use_quota=True,user_id='0617e26fccaf4afcbeff0fac8b91f1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3542860a-d0cb-4c51-9b44-6b3b751a42f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3542860a-d0cb-4c51-9b44-6b3b751a42f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:37 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76e536a-459a-4fa6-80e1-667e1f779950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76e536a-459a-4fa6-80e1-667e1f779950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f24a49cd-87dd-457f-91a3-35927f1ecfb6', 'volume_name': 'volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3ed6dc-9a22-4718-b86a-07b4c57943d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3ed6dc-9a22-4718-b86a-07b4c57943d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9e210b-d82a-489a-9c18-e4a30ed05cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:37 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Volume f24a49cd-87dd-457f-91a3-35927f1ecfb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6', 'volume_size': 1} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1827551311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24a49cd-87dd-457f-91a3-35927f1ecfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fa428f6cbe4cde82a4a92881320b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:37Z,use_quota=True,user_id='0617e26fccaf4afcbeff0fac8b91f1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Creating volume f24a49cd-87dd-457f-91a3-35927f1ecfb6 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:37 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:37 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 1073741824 Jul 23 03:34:37 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:37 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD Jul 23 03:34:37 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:37 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD" returned: 1 in 0.387s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:37 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 1073741824" returned: 0 in 0.546s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:38 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 Jul 23 03:34:38 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:38 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6" returned: 0 in 0.290s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b53f368-84ff-4874-b384-f251838b044e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d09486d39f84300a6297a4f37073560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:35Z,use_quota=True,user_id='13f6b1f7d2dc449ea35e083177cbd704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Creating volume 6b53f368-84ff-4874-b384-f251838b044e {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:38 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9e210b-d82a-489a-9c18-e4a30ed05cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44aadc33-e9df-45c1-8164-45c6fc1957f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:38 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e 1073741824 Jul 23 03:34:38 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:38 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Volume volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 (f24a49cd-87dd-457f-91a3-35927f1ecfb6): created successfully Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44aadc33-e9df-45c1-8164-45c6fc1957f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Flow 'volume_create_manager' (c01a2df5-d55c-4c8a-8694-fc3bbff65808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:38 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6c767111-5b3f-4d4d-a9f5-eb12d36354e9 tempest-ProjectReaderTests-1070529529 None] Created volume successfully. Jul 23 03:34:38 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e 1073741824" returned: 0 in 0.572s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:38 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e Jul 23 03:34:38 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-0f73737a-de75-4e13-ad91-b60e6dde6119 tempest-ProjectAdminTests-1320220369 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577018737793, 'free_capacity_gb': 1775.7577018737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88392) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 03:34:39 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Attempting download of 9378c37c-5acf-4706-ae39-467792825dbf ((None, [{'url': 'file:///opt/stack/data/glance/images/9378c37c-5acf-4706-ae39-467792825dbf', 'metadata': {}}])) to volume 6b53f368-84ff-4874-b384-f251838b044e. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[98622315-58b3-47d8-a4a0-40b500894d5d]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9378c37c-5acf-4706-ae39-467792825dbf_ifjhbwo6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:39 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9378c37c-5acf-4706-ae39-467792825dbf_ifjhbwo6 Jul 23 03:34:39 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Flow 'volume_create_manager' (c722c645-6a08-4dd2-abc5-78a301b06862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ccc6ee-7edb-414f-adfb-1720d34a57fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] Creating offline snapshot 1e54eff6-1c63-4067-bcf2-1a51751f157b of volume f24a49cd-87dd-457f-91a3-35927f1ecfb6 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9378c37c-5acf-4706-ae39-467792825dbf_ifjhbwo6" returned: 0 in 0.536s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9378c37c-5acf-4706-ae39-467792825dbf_ifjhbwo6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ccc6ee-7edb-414f-adfb-1720d34a57fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1650949859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910b64b5-ba1d-4867-a2b5-cdd5b62ef11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c890a7603375401e8b033a9bbe7af682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:40Z,use_quota=True,user_id='0a8fcbfd2a7a4287a54608401488ca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71310289-2d6c-429e-8b0e-1be341d4e122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71310289-2d6c-429e-8b0e-1be341d4e122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92e413b-fa03-4a46-b073-61482f83135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92e413b-fa03-4a46-b073-61482f83135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910b64b5-ba1d-4867-a2b5-cdd5b62ef11b', 'volume_name': 'volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32ec248-d621-4adf-8d91-e9082208080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32ec248-d621-4adf-8d91-e9082208080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee46e187-c5aa-4fb7-86ca-891efff748c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Volume 910b64b5-ba1d-4867-a2b5-cdd5b62ef11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b', 'volume_size': 1} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b1701c-9be5-4e42-888a-0732b4d7fa9c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:39 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9378c37c-5acf-4706-ae39-467792825dbf_ifjhbwo6 Jul 23 03:34:39 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:40 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 Jul 23 03:34:40 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:40 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9378c37c-5acf-4706-ae39-467792825dbf_ifjhbwo6" returned: 1 in 0.399s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9378c37c-5acf-4706-ae39-467792825dbf_ifjhbwo6' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:40 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc13a73-7f07-4d67-9c08-02250dc3b361]: (4, 'raw') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:40 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6" returned: 0 in 0.415s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:40 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b 1G Jul 23 03:34:40 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:40 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD Jul 23 03:34:40 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:40 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:40 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD Jul 23 03:34:40 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:40 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b 1G" returned: 0 in 0.549s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:40 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b Jul 23 03:34:40 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:41 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 03:34:41 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] 9378c37c-5acf-4706-ae39-467792825dbf was raw, converting to qcow2 {{(pid=88392) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 03:34:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:41 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e Jul 23 03:34:41 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:41 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b" returned: 0 in 0.459s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:41 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b is being set with open permissions: ugo+rw Jul 23 03:34:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:41 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b Jul 23 03:34:41 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:41 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b" returned: 0 in 0.454s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:41 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e" returned: 0 in 0.780s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:41 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9378c37c-5acf-4706-ae39-467792825dbf_pwmlcdw5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:34:41 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 03:34:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:41 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e 1G Jul 23 03:34:41 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:41 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.info Jul 23 03:34:41 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:42 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.info" returned: 0 in 0.312s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:42 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.info is being set with open permissions: ugo+rw Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:42 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e 1G" returned: 0 in 0.338s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Downloaded image 9378c37c-5acf-4706-ae39-467792825dbf ((None, [{'url': 'file:///opt/stack/data/glance/images/9378c37c-5acf-4706-ae39-467792825dbf', 'metadata': {}}])) to volume 6b53f368-84ff-4874-b384-f251838b044e successfully. {{(pid=88392) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Temporary image 9378c37c-5acf-4706-ae39-467792825dbf for user 13f6b1f7d2dc449ea35e083177cbd704 is deleted. {{(pid=88392) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.volume_utils [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Marking volume 6b53f368-84ff-4874-b384-f251838b044e as bootable. {{(pid=88392) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 03:34:42 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.info Jul 23 03:34:42 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Copying metadata from image 9378c37c-5acf-4706-ae39-467792825dbf to 6b53f368-84ff-4874-b384-f251838b044e. {{(pid=88392) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Creating volume glance metadata for volume 6b53f368-84ff-4874-b384-f251838b044e backed by image 9378c37c-5acf-4706-ae39-467792825dbf with: {'image_id': '9378c37c-5acf-4706-ae39-467792825dbf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '723c71a0b4213dafb4fe86f136d91760', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88392) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4237dc67-af53-4fa0-be88-d352760f24bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b53f368-84ff-4874-b384-f251838b044e', 'volume_size': 1, 'image_id': '9378c37c-5acf-4706-ae39-467792825dbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9378c37c-5acf-4706-ae39-467792825dbf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '723c71a0b4213dafb4fe86f136d91760', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d09486d39f84300a6297a4f37073560', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '32de51f25ae95fec2b092fb1ab31191b40d7cfb2e75f5741e057fa12b4e8b6e7e31faac93ee9aafa261f21f91519d1533404792d9cc781c5503fc4fb9cc51cb6', 'id': '9378c37c-5acf-4706-ae39-467792825dbf', 'created_at': datetime.datetime(2026, 7, 23, 1, 34, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 1, 34, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9378c37c-5acf-4706-ae39-467792825dbf/file', 'properties': {}}, 'image_service': }' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b174f82-64c6-42c6-a799-ea60f335edfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:42 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Volume volume-6b53f368-84ff-4874-b384-f251838b044e (6b53f368-84ff-4874-b384-f251838b044e): created successfully Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b174f82-64c6-42c6-a799-ea60f335edfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Flow 'volume_create_manager' (96d786d2-90b8-4510-9d66-e6e0b0f7b3ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e1e768d4-29b8-470f-a82e-4340e84fdee3 tempest-VolumeImageDependencyTests-1044847901 None] Created volume successfully. Jul 23 03:34:42 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.info" returned: 0 in 0.244s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.635s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.514s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1650949859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910b64b5-ba1d-4867-a2b5-cdd5b62ef11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c890a7603375401e8b033a9bbe7af682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:40Z,use_quota=True,user_id='0a8fcbfd2a7a4287a54608401488ca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Creating volume 910b64b5-ba1d-4867-a2b5-cdd5b62ef11b {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:42 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:42 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b 1073741824 Jul 23 03:34:42 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ed6b7361-f91c-43cf-914b-d6bbd5340419 tempest-ProjectReaderTests-1070529529 None] Create snapshot completed successfully Jul 23 03:34:42 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Acquiring lock "cinder-6b53f368-84ff-4874-b384-f251838b044e-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b 1073741824" returned: 0 in 0.505s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Lock "cinder-6b53f368-84ff-4874-b384-f251838b044e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-1e54eff6-1c63-4067-bcf2-1a51751f157b-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:43 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b Jul 23 03:34:43 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Acquiring lock "cinder-quobyte-6b53f368-84ff-4874-b384-f251838b044e" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-1e54eff6-1c63-4067-bcf2-1a51751f157b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-f24a49cd-87dd-457f-91a3-35927f1ecfb6" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-f24a49cd-87dd-457f-91a3-35927f1ecfb6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-1e54eff6-1c63-4067-bcf2-1a51751f157b" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Lock "cinder-quobyte-6b53f368-84ff-4874-b384-f251838b044e" acquired by "delete_volume" :: waited 0.031s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-1e54eff6-1c63-4067-bcf2-1a51751f157b" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Deleting offline snapshot 1e54eff6-1c63-4067-bcf2-1a51751f157b of volume f24a49cd-87dd-457f-91a3-35927f1ecfb6 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] snapshot_file for this snap is: volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6522bf2-8a24-4c48-9be9-2a4e50696212]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[01896ebb-60fb-43cf-ad5c-10833b979bd4]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:43 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e Jul 23 03:34:43 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:43 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b Jul 23 03:34:43 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:43 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" returned: 0 in 0.313s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee46e187-c5aa-4fb7-86ca-891efff748c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a99abf-6563-4a88-9b7f-96bceae15ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:43 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Volume volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b (910b64b5-ba1d-4867-a2b5-cdd5b62ef11b): created successfully Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a99abf-6563-4a88-9b7f-96bceae15ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Flow 'volume_create_manager' (c722c645-6a08-4dd2-abc5-78a301b06862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:43 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-359943d1-d25f-40fa-a20c-7d84c6a76576 tempest-VolumeDependencyTests-248137921 None] Created volume successfully. Jul 23 03:34:43 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b" returned: 0 in 0.464s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:34:43 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e" returned: 0 in 0.513s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[336e87e5-eeee-4f87-bd6a-b5335bff7c29]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:43 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e Jul 23 03:34:43 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:43 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 Jul 23 03:34:43 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Flow 'volume_create_manager' (97ca0748-7354-463b-99a3-cf9ece6c0f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e1c97e-d509-4f64-9f74-20519b7cd95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e1c97e-d509-4f64-9f74-20519b7cd95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517638146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c45101-027d-49be-9b5e-59a735e6e760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7180c0a3150d462d9e77cf849c2375af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:44Z,use_quota=True,user_id='98a8727c5bb947d486afe1736bd85c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935c66b6-08ce-41f7-93b2-5c6a5464f62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935c66b6-08ce-41f7-93b2-5c6a5464f62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da18405-98f3-4593-9c46-2336a0337e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da18405-98f3-4593-9c46-2336a0337e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c45101-027d-49be-9b5e-59a735e6e760', 'volume_name': 'volume-85c45101-027d-49be-9b5e-59a735e6e760', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d968b04-92f1-462d-82f0-6ccb6d4ed7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d968b04-92f1-462d-82f0-6ccb6d4ed7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4153aee-1e59-4d8d-b288-7dfd8f5ce3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:43 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Volume 85c45101-027d-49be-9b5e-59a735e6e760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c45101-027d-49be-9b5e-59a735e6e760', 'volume_size': 1} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517638146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c45101-027d-49be-9b5e-59a735e6e760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7180c0a3150d462d9e77cf849c2375af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:44Z,use_quota=True,user_id='98a8727c5bb947d486afe1736bd85c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Creating volume 85c45101-027d-49be-9b5e-59a735e6e760 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:43 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:43 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760 1073741824 Jul 23 03:34:43 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:43 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6b53f368-84ff-4874-b384-f251838b044e" returned: 0 in 0.314s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:43 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Lock "cinder-quobyte-6b53f368-84ff-4874-b384-f251838b044e" released by "delete_volume" :: held 0.928s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Created reservations ['99cab7cc-b809-4098-a4cf-9d547b521ae1', 'b515396b-ffe1-4b05-ae54-d30329602fb0', 'a98f6115-8157-4734-a58a-1e492f9627b8', '970e97cf-142e-40fc-b948-1fb58916d886'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:44 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6" returned: 0 in 0.439s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:44 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b Jul 23 03:34:44 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:44 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:44 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:44 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760 1073741824" returned: 0 in 0.655s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:44 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b" returned: 0 in 0.468s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:44 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b Jul 23 03:34:44 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:44 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760 Jul 23 03:34:44 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:44 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.409s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Deleted volume successfully. Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-3d36d2c6-1aed-485b-b910-daf6c3543d26 tempest-VolumeImageDependencyTests-1044847901 None] Lock "cinder-6b53f368-84ff-4874-b384-f251838b044e-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:44 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6.1e54eff6-1c63-4067-bcf2-1a51751f157b" returned: 0 in 0.270s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-1e54eff6-1c63-4067-bcf2-1a51751f157b" released by "_delete_snapshot" :: held 1.773s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-f24a49cd-87dd-457f-91a3-35927f1ecfb6" released by "delete_snapshot" :: held 1.825s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:44 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760" returned: 0 in 0.316s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.549s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4153aee-1e59-4d8d-b288-7dfd8f5ce3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c45101-027d-49be-9b5e-59a735e6e760', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead120b9-682b-4c30-b536-09e1357544e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] Creating offline snapshot 598d4abd-49eb-4d10-83a0-8a5976e61057 of volume 910b64b5-ba1d-4867-a2b5-cdd5b62ef11b {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:34:44 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Volume volume-85c45101-027d-49be-9b5e-59a735e6e760 (85c45101-027d-49be-9b5e-59a735e6e760): created successfully Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead120b9-682b-4c30-b536-09e1357544e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Flow 'volume_create_manager' (97ca0748-7354-463b-99a3-cf9ece6c0f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f1ab57-3445-4be8-a247-310ac372ff83]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:44 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-76dea675-3e62-428d-8d6e-97203519217a tempest-ProjectReaderTests-1038441590 None] Created volume successfully. Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Created reservations ['db13caca-37f2-48c6-8852-5ea571a9631d', '0129a081-a429-401c-a0aa-5dacd8eac7ba', 'd1a6e762-f8f0-4723-a756-42832c13004c', '777af38c-de35-41ac-80e3-cb588706c080'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Delete snapshot completed successfully. Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-634417bf-cd06-40e5-841d-1537ff101b96 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-1e54eff6-1c63-4067-bcf2-1a51751f157b-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:45 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b Jul 23 03:34:45 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-f24a49cd-87dd-457f-91a3-35927f1ecfb6-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Lock "cinder-f24a49cd-87dd-457f-91a3-35927f1ecfb6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-f24a49cd-87dd-457f-91a3-35927f1ecfb6" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-f24a49cd-87dd-457f-91a3-35927f1ecfb6" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:45 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" returned: 0 in 0.510s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e6a9d2-6324-4c90-9911-2ba54b8aab23]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:45 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 1G Jul 23 03:34:45 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:45 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 Jul 23 03:34:45 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:45 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6" returned: 0 in 0.450s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:45 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6 Jul 23 03:34:45 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:46 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 1G" returned: 0 in 0.571s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:46 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 Jul 23 03:34:46 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "cinder-85c45101-027d-49be-9b5e-59a735e6e760-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-85c45101-027d-49be-9b5e-59a735e6e760-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:46 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-f24a49cd-87dd-457f-91a3-35927f1ecfb6" returned: 0 in 0.401s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-f24a49cd-87dd-457f-91a3-35927f1ecfb6" released by "delete_volume" :: held 0.926s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "cinder-quobyte-85c45101-027d-49be-9b5e-59a735e6e760" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-quobyte-85c45101-027d-49be-9b5e-59a735e6e760" acquired by "delete_volume" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:46 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057" returned: 0 in 0.402s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:46 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 is being set with open permissions: ugo+rw Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3f084c-0973-437f-b677-ed35b2fc4dee]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:46 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 Jul 23 03:34:46 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Created reservations ['f59f0b4e-ddf9-4bab-9eca-08ee2a47c94e', 'e0000146-5cd5-4dab-825d-6be847c89cb2', '5206c8f4-545f-4ef2-b1f6-ef6c43830f6b', 'ee52ed76-fbd0-4e2c-92ef-c30dd768feda'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:46 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760 Jul 23 03:34:46 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:46 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:46 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:46 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057" returned: 0 in 0.299s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:46 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.info Jul 23 03:34:46 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:46 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.263s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:46 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Deleted volume successfully. Jul 23 03:34:46 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760" returned: 0 in 0.416s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:46 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760 Jul 23 03:34:46 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-337a9d21-6d24-4469-b3f5-dc78e2bb109f tempest-ProjectReaderTests-1070529529 None] Lock "cinder-f24a49cd-87dd-457f-91a3-35927f1ecfb6-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:47 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.info" returned: 0 in 0.270s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:47 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.info is being set with open permissions: ugo+rw Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:47 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.info Jul 23 03:34:47 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:47 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-85c45101-027d-49be-9b5e-59a735e6e760" returned: 0 in 0.266s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-quobyte-85c45101-027d-49be-9b5e-59a735e6e760" released by "delete_volume" :: held 0.764s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Created reservations ['d9ac762e-f617-4af6-8e8c-b9dd6024d3d8', '6defca22-0b1a-4e8b-85a1-999461b60523', 'dbb1c7bb-6ca0-47dc-b0aa-9beafc98d6f5', 'c21cfa18-cb2f-46f6-a142-c37a96264ce1'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:47 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:47 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.info" returned: 0 in 0.307s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:47 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.496s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-de1499ab-3b38-4f30-a748-2e0757d51c77 tempest-VolumeDependencyTests-248137921 None] Create snapshot completed successfully Jul 23 03:34:47 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.383s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Deleted volume successfully. Jul 23 03:34:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c40232a8-ffa5-4585-9898-6d8e9fee1c64 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-85c45101-027d-49be-9b5e-59a735e6e760-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Flow 'volume_create_manager' (375cd8fa-c87c-453b-92a3-589ac0508263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2941270-d4b2-4ad8-b1b7-41f5dbe89966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2941270-d4b2-4ad8-b1b7-41f5dbe89966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-181771686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad4a3cb-878b-4794-a5a8-d6459cf67d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7180c0a3150d462d9e77cf849c2375af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:48Z,use_quota=True,user_id='98a8727c5bb947d486afe1736bd85c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3164d9ab-02fa-42ae-85e3-ecdff940a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3164d9ab-02fa-42ae-85e3-ecdff940a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bf097c-9e41-43ea-9181-5c2a759ba155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bf097c-9e41-43ea-9181-5c2a759ba155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad4a3cb-878b-4794-a5a8-d6459cf67d38', 'volume_name': 'volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fe5f58-d8ab-440e-94dc-2d1e64ecb003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fe5f58-d8ab-440e-94dc-2d1e64ecb003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef55a3a-c659-419d-91c8-b8d8b97b1077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Volume dad4a3cb-878b-4794-a5a8-d6459cf67d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38', 'volume_size': 1} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-181771686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad4a3cb-878b-4794-a5a8-d6459cf67d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7180c0a3150d462d9e77cf849c2375af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:48Z,use_quota=True,user_id='98a8727c5bb947d486afe1736bd85c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Creating volume dad4a3cb-878b-4794-a5a8-d6459cf67d38 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:48 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:48 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38 1073741824 Jul 23 03:34:48 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Flow 'volume_create_manager' (6d3fe7f9-5257-41d1-8ecd-53b1ef63e6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ec0239-905c-468f-9c84-eea04857831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ec0239-905c-468f-9c84-eea04857831c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1439053165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49deb276-e90a-4ddc-9177-857f9495257d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c890a7603375401e8b033a9bbe7af682',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=598d4abd-49eb-4d10-83a0-8a5976e61057,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:48Z,use_quota=True,user_id='0a8fcbfd2a7a4287a54608401488ca2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4338a7-9813-4af7-8d9a-f2cb6212ab40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4338a7-9813-4af7-8d9a-f2cb6212ab40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375423bb-c428-46ca-a467-ef815a50893f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375423bb-c428-46ca-a467-ef815a50893f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '49deb276-e90a-4ddc-9177-857f9495257d', 'volume_name': 'volume-49deb276-e90a-4ddc-9177-857f9495257d', 'volume_size': 1, 'snapshot_id': '598d4abd-49eb-4d10-83a0-8a5976e61057'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2ca451-a4e3-4da3-bff3-0eca127bc600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2ca451-a4e3-4da3-bff3-0eca127bc600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d59d17-dd86-41d3-a2e1-8c0cf7b85af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Volume 49deb276-e90a-4ddc-9177-857f9495257d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-49deb276-e90a-4ddc-9177-857f9495257d', 'volume_size': 1, 'snapshot_id': '598d4abd-49eb-4d10-83a0-8a5976e61057'} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:48 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Flow 'volume_create_manager' (1bbf0d26-ca16-4220-b46d-ccbcf4cac92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88d83f0-4435-46cf-ab8f-863946900b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38 1073741824" returned: 0 in 0.557s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88d83f0-4435-46cf-ab8f-863946900b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596193864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75a3809-3304-425c-abd8-7a01c936195e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fa428f6cbe4cde82a4a92881320b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:49Z,use_quota=True,user_id='0617e26fccaf4afcbeff0fac8b91f1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a26a37-a25e-4aae-be7f-a573895728ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a26a37-a25e-4aae-be7f-a573895728ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a0dd8e-2578-467c-80d6-aa55e6f0091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a0dd8e-2578-467c-80d6-aa55e6f0091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75a3809-3304-425c-abd8-7a01c936195e', 'volume_name': 'volume-b75a3809-3304-425c-abd8-7a01c936195e', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c685e342-871e-4e0e-985f-3ac78a605a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c685e342-871e-4e0e-985f-3ac78a605a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a51d804-e203-46df-8491-0bb3629a585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:48 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Volume b75a3809-3304-425c-abd8-7a01c936195e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75a3809-3304-425c-abd8-7a01c936195e', 'volume_size': 1} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:48 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38 Jul 23 03:34:48 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:49 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38" returned: 0 in 0.244s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.368s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "cinder-quobyte-598d4abd-49eb-4d10-83a0-8a5976e61057-49deb276-e90a-4ddc-9177-857f9495257d" by "_create_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef55a3a-c659-419d-91c8-b8d8b97b1077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f033a3-9e8b-43f3-9300-2f8b3c9f2924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-598d4abd-49eb-4d10-83a0-8a5976e61057-49deb276-e90a-4ddc-9177-857f9495257d" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Creating volume 49deb276-e90a-4ddc-9177-857f9495257d from snapshot 598d4abd-49eb-4d10-83a0-8a5976e61057 {{(pid=88392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "cinder-quobyte-49deb276-e90a-4ddc-9177-857f9495257d" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:49 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Volume volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38 (dad4a3cb-878b-4794-a5a8-d6459cf67d38): created successfully Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f033a3-9e8b-43f3-9300-2f8b3c9f2924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Flow 'volume_create_manager' (375cd8fa-c87c-453b-92a3-589ac0508263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-49deb276-e90a-4ddc-9177-857f9495257d" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] snapshot: 598d4abd-49eb-4d10-83a0-8a5976e61057, volume: 49deb276-e90a-4ddc-9177-857f9495257d, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:34:49 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5e43cecc-4c18-4eea-8d8c-8514c24a0ce0 tempest-ProjectReaderTests-1038441590 None] Created volume successfully. Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a6a7a4-b64b-4644-a672-b36121c03903]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:49 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 Jul 23 03:34:49 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "cinder-dad4a3cb-878b-4794-a5a8-d6459cf67d38-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-dad4a3cb-878b-4794-a5a8-d6459cf67d38-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "cinder-quobyte-dad4a3cb-878b-4794-a5a8-d6459cf67d38" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-quobyte-dad4a3cb-878b-4794-a5a8-d6459cf67d38" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[882582b1-bce9-45ea-9c4e-cc17c0d81aff]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:49 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057" returned: 0 in 0.482s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e017df-771d-4482-aac9-8f9e9ffa4aac]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:49 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38 Jul 23 03:34:49 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:49 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b Jul 23 03:34:49 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:49 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38" returned: 0 in 0.434s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:49 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:50 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38 Jul 23 03:34:50 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:50 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" returned: 0 in 0.407s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:50 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d Jul 23 03:34:50 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:50 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-dad4a3cb-878b-4794-a5a8-d6459cf67d38" returned: 0 in 0.255s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-quobyte-dad4a3cb-878b-4794-a5a8-d6459cf67d38" released by "delete_volume" :: held 0.741s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Created reservations ['6243ddb7-dad8-4381-9d89-eed2036de3e3', '63b747f8-d53e-4d89-b51b-29c710fe7981', '46291a87-6037-48c5-9ef5-a71a3879bc4e', '58ffd96b-7766-454a-8d5e-fc371d392a9f'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:50 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:34:50 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:51 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.626s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:51 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:34:51 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Deleted volume successfully. Jul 23 03:34:51 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-02970734-13a2-4e37-becd-f5ab62c0d700 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-dad4a3cb-878b-4794-a5a8-d6459cf67d38-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Flow 'volume_create_manager' (2f9a16a9-e64d-4ea6-914e-f912f073cbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c1f89b-ed87-4ca3-991d-a1ee459ccc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c1f89b-ed87-4ca3-991d-a1ee459ccc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814859291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fac6668-4963-40c8-8c4d-f89e7b5ffd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7180c0a3150d462d9e77cf849c2375af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:52Z,use_quota=True,user_id='98a8727c5bb947d486afe1736bd85c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf49bf3-ac1c-40bb-a7e3-032da68aa090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf49bf3-ac1c-40bb-a7e3-032da68aa090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bb0531-3d32-4541-a4e0-c741b701b310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bb0531-3d32-4541-a4e0-c741b701b310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fac6668-4963-40c8-8c4d-f89e7b5ffd56', 'volume_name': 'volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4771d9a7-13f7-4d87-87ef-56eb0cfb27c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4771d9a7-13f7-4d87-87ef-56eb0cfb27c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f0d0ce-0806-4190-8e9b-53a18db77e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:52 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Volume 6fac6668-4963-40c8-8c4d-f89e7b5ffd56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56', 'volume_size': 1} Jul 23 03:34:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:55 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d" returned: 0 in 5.456s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:55 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad26abc-5c72-48a9-a9b7-5d9883244ddf]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:55 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b Jul 23 03:34:55 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:56 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" returned: 0 in 0.585s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:34:56 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Converted 1024.00 MB image at 187.60 MB/s Jul 23 03:34:56 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d is being set with open permissions: ugo+rw Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:56 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d Jul 23 03:34:56 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:56 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d" returned: 0 in 0.244s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-49deb276-e90a-4ddc-9177-857f9495257d" released by "_copy_volume_from_snapshot" :: held 7.296s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-598d4abd-49eb-4d10-83a0-8a5976e61057-49deb276-e90a-4ddc-9177-857f9495257d" released by "_create_volume_from_snapshot" :: held 7.346s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.373s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.651s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596193864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75a3809-3304-425c-abd8-7a01c936195e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fa428f6cbe4cde82a4a92881320b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:49Z,use_quota=True,user_id='0617e26fccaf4afcbeff0fac8b91f1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Creating volume b75a3809-3304-425c-abd8-7a01c936195e {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:56 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:SELECT=233,cinder:UPDATE=309,cinder:INSERT=85,cinder:DELETE=27 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:34:56 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e 1073741824 Jul 23 03:34:56 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=317,cinder:SELECT=225,cinder:DELETE=29,cinder:INSERT=81 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d59d17-dd86-41d3-a2e1-8c0cf7b85af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49deb276-e90a-4ddc-9177-857f9495257d', 'volume_size': 1, 'snapshot_id': '598d4abd-49eb-4d10-83a0-8a5976e61057'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b625d67d-462b-4b3f-877d-590f55dea2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:56 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Volume volume-49deb276-e90a-4ddc-9177-857f9495257d (49deb276-e90a-4ddc-9177-857f9495257d): created successfully Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b625d67d-462b-4b3f-877d-590f55dea2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Flow 'volume_create_manager' (6d3fe7f9-5257-41d1-8ecd-53b1ef63e6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:56 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2c893430-7a4f-43a2-b669-74f17d2cc7b7 tempest-VolumeDependencyTests-248137921 None] Created volume successfully. Jul 23 03:34:56 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e 1073741824" returned: 0 in 0.522s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:57 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e Jul 23 03:34:57 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:57 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "cinder-598d4abd-49eb-4d10-83a0-8a5976e61057-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e" returned: 0 in 0.268s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.983s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814859291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fac6668-4963-40c8-8c4d-f89e7b5ffd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7180c0a3150d462d9e77cf849c2375af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:34:52Z,use_quota=True,user_id='98a8727c5bb947d486afe1736bd85c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Creating volume 6fac6668-4963-40c8-8c4d-f89e7b5ffd56 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:34:57 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:57 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56 1073741824 Jul 23 03:34:57 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a51d804-e203-46df-8491-0bb3629a585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75a3809-3304-425c-abd8-7a01c936195e', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdb5151-4bc1-4598-b554-c33168cb7f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-598d4abd-49eb-4d10-83a0-8a5976e61057-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "cinder-quobyte-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "cinder-quobyte-598d4abd-49eb-4d10-83a0-8a5976e61057" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:57 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Volume volume-b75a3809-3304-425c-abd8-7a01c936195e (b75a3809-3304-425c-abd8-7a01c936195e): created successfully Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdb5151-4bc1-4598-b554-c33168cb7f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Flow 'volume_create_manager' (1bbf0d26-ca16-4220-b46d-ccbcf4cac92e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-598d4abd-49eb-4d10-83a0-8a5976e61057" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Deleting offline snapshot 598d4abd-49eb-4d10-83a0-8a5976e61057 of volume 910b64b5-ba1d-4867-a2b5-cdd5b62ef11b {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] snapshot_file for this snap is: volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:34:57 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7f9f8f6a-efbe-425c-b4fc-e715a02a2912 tempest-ProjectReaderTests-1070529529 None] Created volume successfully. Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0e075e-7556-4f9a-b6ea-82bd5926cb91]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:57 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 Jul 23 03:34:57 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:57 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56 1073741824" returned: 0 in 0.461s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:57 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56 Jul 23 03:34:57 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:57 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057" returned: 0 in 0.403s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cedadf5-29a7-45bc-8795-81b4696fb04c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:57 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b Jul 23 03:34:57 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:58 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56" returned: 0 in 0.310s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f0d0ce-0806-4190-8e9b-53a18db77e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6072ab85-75f5-4de2-83c3-ee7b55ec43c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:34:58 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Volume volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56 (6fac6668-4963-40c8-8c4d-f89e7b5ffd56): created successfully Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6072ab85-75f5-4de2-83c3-ee7b55ec43c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Flow 'volume_create_manager' (2f9a16a9-e64d-4ea6-914e-f912f073cbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:34:58 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-bf445804-66e9-4590-9541-7daed117989d tempest-ProjectReaderTests-1038441590 None] Created volume successfully. Jul 23 03:34:58 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" returned: 0 in 0.428s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:58 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 Jul 23 03:34:58 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] Creating offline snapshot e8343bde-cd43-47e0-b7b1-977bc28f0774 of volume b75a3809-3304-425c-abd8-7a01c936195e {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1ca4a7-7a52-442c-abe5-402599840cf2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:58 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e Jul 23 03:34:58 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:58 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057" returned: 0 in 0.449s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:58 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057 Jul 23 03:34:58 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:58 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e" returned: 0 in 0.429s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:58 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 1G Jul 23 03:34:58 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:58 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b.598d4abd-49eb-4d10-83a0-8a5976e61057" returned: 0 in 0.278s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-598d4abd-49eb-4d10-83a0-8a5976e61057" released by "_delete_snapshot" :: held 1.689s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" released by "delete_snapshot" :: held 1.731s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Created reservations ['fc6f2e34-8096-4555-901d-f86e51a77552', '2ed8f107-87a7-49f5-828b-a06d5ffe7a57', '74e662aa-f4e8-4d56-bbda-a6f795643818', '3c32827b-d2d8-410f-b006-aeb6dcf59203'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:34:59 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Delete snapshot completed successfully. Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-67bacf47-c4dc-462f-a035-6de2541be937 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-598d4abd-49eb-4d10-83a0-8a5976e61057-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "cinder-6fac6668-4963-40c8-8c4d-f89e7b5ffd56-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-6fac6668-4963-40c8-8c4d-f89e7b5ffd56-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "cinder-quobyte-6fac6668-4963-40c8-8c4d-f89e7b5ffd56" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-quobyte-6fac6668-4963-40c8-8c4d-f89e7b5ffd56" acquired by "delete_volume" :: waited 0.042s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae0bca6-19ba-45a8-a8bb-5c147101316d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "cinder-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:59 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "cinder-quobyte-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 1G" returned: 0 in 0.591s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75a3809-3304-425c-abd8-7a01c936195e -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" acquired by "delete_volume" :: waited 0.038s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:34:59 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75a3809-3304-425c-abd8-7a01c936195e -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 Jul 23 03:34:59 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:59 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56 Jul 23 03:34:59 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d153355-9abd-4071-9e67-16789a99e4c7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:59 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b Jul 23 03:34:59 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:59 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56" returned: 0 in 0.444s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:59 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75a3809-3304-425c-abd8-7a01c936195e -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774" returned: 0 in 0.349s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:34:59 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 is being set with open permissions: ugo+rw Jul 23 03:34:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:34:59 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56 Jul 23 03:34:59 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:34:59 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 Jul 23 03:34:59 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:00 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" returned: 0 in 0.452s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:00 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b Jul 23 03:35:00 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:00 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774" returned: 0 in 0.290s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:00 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-6fac6668-4963-40c8-8c4d-f89e7b5ffd56" returned: 0 in 0.318s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-quobyte-6fac6668-4963-40c8-8c4d-f89e7b5ffd56" released by "delete_volume" :: held 0.841s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:00 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.info Jul 23 03:35:00 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Created reservations ['04a1e373-a5c6-4ff8-a37c-8f83454c8469', '795431c9-a8f9-44c1-b06b-15c136d5e48d', 'f8f2ea43-b5ce-48bb-b3f5-352dc4c7d63d', '3dcbfe24-d1bb-4c54-8bb7-4177c86d8ec6'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:00 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" returned: 0 in 0.306s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b" released by "delete_volume" :: held 0.884s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:00 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:00 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Created reservations ['4eeb602f-3a71-4d03-ac0a-163c3375cff3', 'b548735b-c69b-4359-85ca-5eee0503e90b', '8b144ab3-e60c-4c87-8dae-cc9eed674df2', '94d86b43-9ed4-42fc-9fa3-1f078f847562'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:00 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.info" returned: 0 in 0.420s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:00 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.info is being set with open permissions: ugo+rw Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:00 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:00 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:00 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.info Jul 23 03:35:00 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:00 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.379s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:00 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Deleted volume successfully. Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-28a32d37-8ebf-482e-b688-995de44f5fe6 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-6fac6668-4963-40c8-8c4d-f89e7b5ffd56-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "cinder-49deb276-e90a-4ddc-9177-857f9495257d-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:00 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-49deb276-e90a-4ddc-9177-857f9495257d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "cinder-quobyte-49deb276-e90a-4ddc-9177-857f9495257d" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-49deb276-e90a-4ddc-9177-857f9495257d" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:01 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.info" returned: 0 in 0.412s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[664a76e1-195c-475a-a127-bc79c00e8dca]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:01 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.540s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:01 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-29d9c429-9550-4e79-93dd-8d907dfe4de5 tempest-ProjectReaderTests-1070529529 None] Create snapshot completed successfully Jul 23 03:35:01 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Deleted volume successfully. Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ab4c93ea-afe1-40b4-b194-1309afefb909 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-910b64b5-ba1d-4867-a2b5-cdd5b62ef11b-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:01 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d Jul 23 03:35:01 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Flow 'volume_create_manager' (d8acdd4c-33d0-4780-a0f1-0cab966deea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e755b677-72dd-4115-a6d2-116caca7114a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e755b677-72dd-4115-a6d2-116caca7114a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1142931574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e26260-cb19-4adb-87a2-4b992beac46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7180c0a3150d462d9e77cf849c2375af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:01Z,use_quota=True,user_id='98a8727c5bb947d486afe1736bd85c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae93685c-9124-4ba5-8270-a10534e36f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae93685c-9124-4ba5-8270-a10534e36f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88edf691-24fc-4f0e-a638-98ce714cd570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88edf691-24fc-4f0e-a638-98ce714cd570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e26260-cb19-4adb-87a2-4b992beac46b', 'volume_name': 'volume-22e26260-cb19-4adb-87a2-4b992beac46b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8f1ed0-372d-447c-a7db-2f12fe1f808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8f1ed0-372d-447c-a7db-2f12fe1f808f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b7482a-c0e1-4ece-8a22-8dfb51f26630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:01 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Volume 22e26260-cb19-4adb-87a2-4b992beac46b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e26260-cb19-4adb-87a2-4b992beac46b', 'volume_size': 1} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1142931574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e26260-cb19-4adb-87a2-4b992beac46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7180c0a3150d462d9e77cf849c2375af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:01Z,use_quota=True,user_id='98a8727c5bb947d486afe1736bd85c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Creating volume 22e26260-cb19-4adb-87a2-4b992beac46b {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:01 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:01 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b 1073741824 Jul 23 03:35:01 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:01 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d" returned: 0 in 0.454s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:01 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d Jul 23 03:35:01 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:01 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-49deb276-e90a-4ddc-9177-857f9495257d" returned: 0 in 0.247s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-quobyte-49deb276-e90a-4ddc-9177-857f9495257d" released by "delete_volume" :: held 0.804s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Created reservations ['c7084949-239a-4868-a938-150d044c0c75', 'e3ba3811-83f6-4725-85d5-d79395f8f5e2', '3330e5b1-0dfa-4635-8b83-191bca41130d', 'c02d191d-7c06-4471-a6d5-914f84c6d751'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-e8343bde-cd43-47e0-b7b1-977bc28f0774-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-e8343bde-cd43-47e0-b7b1-977bc28f0774-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:01 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-b75a3809-3304-425c-abd8-7a01c936195e" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-b75a3809-3304-425c-abd8-7a01c936195e" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-e8343bde-cd43-47e0-b7b1-977bc28f0774" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:02 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b 1073741824" returned: 0 in 0.543s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-e8343bde-cd43-47e0-b7b1-977bc28f0774" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Deleting offline snapshot e8343bde-cd43-47e0-b7b1-977bc28f0774 of volume b75a3809-3304-425c-abd8-7a01c936195e {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] snapshot_file for this snap is: volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6006c5-ef0a-4974-ba72-cedddcb8116c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:02 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:02 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:02 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b Jul 23 03:35:02 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:02 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 Jul 23 03:35:02 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:02 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.409s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:02 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Deleted volume successfully. Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6ace9d20-c649-4a75-980d-fc31d58da5f1 tempest-VolumeDependencyTests-248137921 None] Lock "cinder-49deb276-e90a-4ddc-9177-857f9495257d-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:02 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b" returned: 0 in 0.485s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b7482a-c0e1-4ece-8a22-8dfb51f26630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e26260-cb19-4adb-87a2-4b992beac46b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfc3cbe-6c0f-49eb-abb9-c146a024fb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:02 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Volume volume-22e26260-cb19-4adb-87a2-4b992beac46b (22e26260-cb19-4adb-87a2-4b992beac46b): created successfully Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfc3cbe-6c0f-49eb-abb9-c146a024fb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:02 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Flow 'volume_create_manager' (d8acdd4c-33d0-4780-a0f1-0cab966deea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774" returned: 0 in 0.590s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75a3809-3304-425c-abd8-7a01c936195e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:35:02 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f00c8868-6d1f-458e-b14f-f4987a25d219 tempest-ProjectReaderTests-1038441590 None] Created volume successfully. Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0931b0d-108c-405b-8862-80a420d0a720]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:02 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e Jul 23 03:35:02 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:03 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e" returned: 0 in 0.452s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:03 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 Jul 23 03:35:03 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "cinder-22e26260-cb19-4adb-87a2-4b992beac46b-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-22e26260-cb19-4adb-87a2-4b992beac46b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "cinder-quobyte-22e26260-cb19-4adb-87a2-4b992beac46b" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-quobyte-22e26260-cb19-4adb-87a2-4b992beac46b" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb58f71c-8e99-4593-a210-d9a33d5f2209]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:03 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774" returned: 0 in 0.432s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:03 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774 Jul 23 03:35:03 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:03 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b Jul 23 03:35:03 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:03 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e.e8343bde-cd43-47e0-b7b1-977bc28f0774" returned: 0 in 0.255s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-e8343bde-cd43-47e0-b7b1-977bc28f0774" released by "_delete_snapshot" :: held 1.876s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-b75a3809-3304-425c-abd8-7a01c936195e" released by "delete_snapshot" :: held 1.920s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:03 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Created reservations ['4160e97b-e487-4917-90bd-469ae113ab54', '27771eca-c1f8-48c0-9366-99274daeb137', 'e1a276b1-bbbf-4dac-8034-807c5fd91a56', '98567023-2f28-454a-b7c9-f2ed648b2c25'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:04 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b" returned: 0 in 0.410s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:04 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b Jul 23 03:35:04 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:04 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Delete snapshot completed successfully. Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-7bf98b38-f986-495a-b810-86e970bce3d8 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-e8343bde-cd43-47e0-b7b1-977bc28f0774-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-b75a3809-3304-425c-abd8-7a01c936195e-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-b75a3809-3304-425c-abd8-7a01c936195e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-b75a3809-3304-425c-abd8-7a01c936195e" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-b75a3809-3304-425c-abd8-7a01c936195e" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbb475a-7233-41d4-a39f-5461d0bd285a]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:04 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e26260-cb19-4adb-87a2-4b992beac46b" returned: 0 in 0.333s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-quobyte-22e26260-cb19-4adb-87a2-4b992beac46b" released by "delete_volume" :: held 0.790s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Created reservations ['ea03d3fa-1b49-4f7c-a461-ea3e80462b74', '736d6990-e9bc-4ec3-88ec-66ef91cf43e6', 'd7ffe979-59c6-4e35-ae54-33f5ff9b7e13', '5c4ddbc5-4186-42b5-92fb-2027c69761a6'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:04 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e Jul 23 03:35:04 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:04 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:04 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:04 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e" returned: 0 in 0.563s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:04 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.348s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:04 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e Jul 23 03:35:04 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:04 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Deleted volume successfully. Jul 23 03:35:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5d582991-e7fc-43f4-a1be-78060ce4bc90 tempest-ProjectReaderTests-1038441590 None] Lock "cinder-22e26260-cb19-4adb-87a2-4b992beac46b-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:05 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b75a3809-3304-425c-abd8-7a01c936195e" returned: 0 in 0.355s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-b75a3809-3304-425c-abd8-7a01c936195e" released by "delete_volume" :: held 1.015s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Created reservations ['0913e812-986c-45dd-b352-41857550f93f', '8426a7b7-d20f-4b7a-b0a1-578f301a97da', 'e88c1a6c-a0dc-4822-915f-fd3bf89f80c9', '6b02e61c-72d2-47f3-bf27-8c5a3da9c325'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:05 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:05 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:05 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.270s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:05 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Deleted volume successfully. Jul 23 03:35:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-66415703-12d0-4f1d-9de0-c62657430cf5 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-b75a3809-3304-425c-abd8-7a01c936195e-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (1c20512b-bb93-4d23-9eae-254b61ee54ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7be75cb-0983-4269-9fe1-85e46968d0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7be75cb-0983-4269-9fe1-85e46968d0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-860401640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46ff627-f92e-44ad-a622-62aec488daa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:07Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569b1514-bc49-433e-8abe-b5a0f8118cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569b1514-bc49-433e-8abe-b5a0f8118cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e02436-3f2b-4671-930c-f393be6cf076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e02436-3f2b-4671-930c-f393be6cf076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46ff627-f92e-44ad-a622-62aec488daa6', 'volume_name': 'volume-a46ff627-f92e-44ad-a622-62aec488daa6', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a39a02-cb63-4f2b-939c-c33edc1612ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a39a02-cb63-4f2b-939c-c33edc1612ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7593c1-6e17-4a82-82b5-b62e1e73f35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:06 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Volume a46ff627-f92e-44ad-a622-62aec488daa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46ff627-f92e-44ad-a622-62aec488daa6', 'volume_size': 1} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-860401640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46ff627-f92e-44ad-a622-62aec488daa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:07Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Creating volume a46ff627-f92e-44ad-a622-62aec488daa6 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:06 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:06 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 1073741824 Jul 23 03:35:06 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:07 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:07 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Flow 'volume_create_manager' (89d212eb-f228-4547-a3ea-5f2421c46464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e863f0ba-ee5a-42cc-9924-8eef3affcefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e863f0ba-ee5a-42cc-9924-8eef3affcefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447430551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16896762-0009-494b-b4c0-dcc59e5123d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fa428f6cbe4cde82a4a92881320b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:07Z,use_quota=True,user_id='0617e26fccaf4afcbeff0fac8b91f1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfba0825-3deb-4336-a6d0-adaf0b491c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:07 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfba0825-3deb-4336-a6d0-adaf0b491c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3cd6b4-0e88-4ead-bc52-9b4ee29b0e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3cd6b4-0e88-4ead-bc52-9b4ee29b0e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16896762-0009-494b-b4c0-dcc59e5123d3', 'volume_name': 'volume-16896762-0009-494b-b4c0-dcc59e5123d3', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c08d183-6fb1-469e-9796-8592e1480891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c08d183-6fb1-469e-9796-8592e1480891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41dae6f-7a42-4c46-a798-ca16c70701e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:07 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Volume 16896762-0009-494b-b4c0-dcc59e5123d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16896762-0009-494b-b4c0-dcc59e5123d3', 'volume_size': 1} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.404s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:35:07 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 1073741824" returned: 0 in 0.525s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:07 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 Jul 23 03:35:07 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:07 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6" returned: 0 in 0.249s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.354s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1447430551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16896762-0009-494b-b4c0-dcc59e5123d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fa428f6cbe4cde82a4a92881320b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:07Z,use_quota=True,user_id='0617e26fccaf4afcbeff0fac8b91f1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Creating volume 16896762-0009-494b-b4c0-dcc59e5123d3 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:07 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7593c1-6e17-4a82-82b5-b62e1e73f35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46ff627-f92e-44ad-a622-62aec488daa6', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c8f7aa-29c8-47ae-baf8-588c7723d3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:07 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 1073741824 Jul 23 03:35:07 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:07 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Volume volume-a46ff627-f92e-44ad-a622-62aec488daa6 (a46ff627-f92e-44ad-a622-62aec488daa6): created successfully Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c8f7aa-29c8-47ae-baf8-588c7723d3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (1c20512b-bb93-4d23-9eae-254b61ee54ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:07 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-45c0e93d-f08d-4a8c-ad3e-c078cdf5488c tempest-ProjectMemberTests-1042172611 None] Created volume successfully. Jul 23 03:35:08 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 1073741824" returned: 0 in 0.502s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:08 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 Jul 23 03:35:08 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:08 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3" returned: 0 in 0.248s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41dae6f-7a42-4c46-a798-ca16c70701e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16896762-0009-494b-b4c0-dcc59e5123d3', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82da9b6a-9f84-4dda-ace0-80003d2640c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:08 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Volume volume-16896762-0009-494b-b4c0-dcc59e5123d3 (16896762-0009-494b-b4c0-dcc59e5123d3): created successfully Jul 23 03:35:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82da9b6a-9f84-4dda-ace0-80003d2640c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Flow 'volume_create_manager' (89d212eb-f228-4547-a3ea-5f2421c46464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:08 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-85e9c822-190c-4b5a-859e-522d665c86e4 tempest-ProjectReaderTests-1070529529 None] Created volume successfully. Jul 23 03:35:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] Creating offline snapshot e27fe75a-4a93-4d26-abc8-65b6b26262b9 of volume a46ff627-f92e-44ad-a622-62aec488daa6 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:35:09 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2c2161-392c-4494-b465-60e95205f79f]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:09 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 Jul 23 03:35:09 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:09 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6" returned: 0 in 0.425s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:09 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 1G Jul 23 03:35:09 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:10 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 1G" returned: 0 in 0.417s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46ff627-f92e-44ad-a622-62aec488daa6 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:10 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46ff627-f92e-44ad-a622-62aec488daa6 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 Jul 23 03:35:10 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:10 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a46ff627-f92e-44ad-a622-62aec488daa6 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9" returned: 0 in 0.317s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:10 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 is being set with open permissions: ugo+rw Jul 23 03:35:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:10 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 Jul 23 03:35:10 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:10 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9" returned: 0 in 0.248s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:10 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.info Jul 23 03:35:10 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:11 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.info" returned: 0 in 0.265s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:11 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.info is being set with open permissions: ugo+rw Jul 23 03:35:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:11 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.info Jul 23 03:35:11 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:11 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.info" returned: 0 in 0.287s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.993s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] Creating offline snapshot 996ec934-3ea8-49bf-982b-03abe8f1c08a of volume 16896762-0009-494b-b4c0-dcc59e5123d3 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:35:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ef2c1097-3e7b-45f9-9a18-4fb03254a7db tempest-ProjectMemberTests-1042172611 None] Create snapshot completed successfully Jul 23 03:35:11 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ec2a03-0383-4f27-afea-622d750f8fa9]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:11 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 Jul 23 03:35:11 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:11 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3" returned: 0 in 0.362s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:11 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a 1G Jul 23 03:35:11 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:12 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a 1G" returned: 0 in 0.436s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16896762-0009-494b-b4c0-dcc59e5123d3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:12 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16896762-0009-494b-b4c0-dcc59e5123d3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a Jul 23 03:35:12 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-e27fe75a-4a93-4d26-abc8-65b6b26262b9-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Lock "cinder-e27fe75a-4a93-4d26-abc8-65b6b26262b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-a46ff627-f92e-44ad-a622-62aec488daa6" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-a46ff627-f92e-44ad-a622-62aec488daa6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-e27fe75a-4a93-4d26-abc8-65b6b26262b9" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-e27fe75a-4a93-4d26-abc8-65b6b26262b9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Deleting offline snapshot e27fe75a-4a93-4d26-abc8-65b6b26262b9 of volume a46ff627-f92e-44ad-a622-62aec488daa6 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] snapshot_file for this snap is: volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f7f17a-bbac-4c6a-ad03-81b38e952754]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:12 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16896762-0009-494b-b4c0-dcc59e5123d3 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a" returned: 0 in 0.375s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:12 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a is being set with open permissions: ugo+rw Jul 23 03:35:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:12 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a Jul 23 03:35:12 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:12 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 Jul 23 03:35:12 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:13 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a" returned: 0 in 0.277s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:13 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.info Jul 23 03:35:13 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:13 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9" returned: 0 in 0.413s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a46ff627-f92e-44ad-a622-62aec488daa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a542c6-e8bb-4045-b7fb-b7bb2fa37bbe]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:13 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 Jul 23 03:35:13 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:13 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.info" returned: 0 in 0.282s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:13 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.info is being set with open permissions: ugo+rw Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:13 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.info Jul 23 03:35:13 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:13 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6" returned: 0 in 0.369s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:13 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 Jul 23 03:35:13 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:13 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.info" returned: 0 in 0.266s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.119s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4cdb5b3f-0f3d-434e-9858-087e6f1ef5f1 tempest-ProjectReaderTests-1070529529 None] Create snapshot completed successfully Jul 23 03:35:13 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9" returned: 0 in 0.336s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:13 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9 Jul 23 03:35:13 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:14 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6.e27fe75a-4a93-4d26-abc8-65b6b26262b9" returned: 0 in 0.231s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-e27fe75a-4a93-4d26-abc8-65b6b26262b9" released by "_delete_snapshot" :: held 1.459s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-a46ff627-f92e-44ad-a622-62aec488daa6" released by "delete_snapshot" :: held 1.486s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Created reservations ['08695beb-2fb5-449d-8a81-702f789b209b', '3017253f-0a90-48dd-8d06-1a3fa954ebe5', '06ebb4d1-eb9f-48ea-8afb-aeed7c3e4222', '1ce693b8-c969-421c-9e0e-5dbe7f1955f6'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:14 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Delete snapshot completed successfully. Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0edb04c9-cc5b-4488-ab26-6ee64538f95f tempest-ProjectMemberTests-1042172611 None] Lock "cinder-e27fe75a-4a93-4d26-abc8-65b6b26262b9-delete_snapshot" released by "delete_snapshot" :: held 1.613s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-996ec934-3ea8-49bf-982b-03abe8f1c08a-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-996ec934-3ea8-49bf-982b-03abe8f1c08a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-16896762-0009-494b-b4c0-dcc59e5123d3" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-16896762-0009-494b-b4c0-dcc59e5123d3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-996ec934-3ea8-49bf-982b-03abe8f1c08a" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-a46ff627-f92e-44ad-a622-62aec488daa6-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-996ec934-3ea8-49bf-982b-03abe8f1c08a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Deleting offline snapshot 996ec934-3ea8-49bf-982b-03abe8f1c08a of volume 16896762-0009-494b-b4c0-dcc59e5123d3 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] snapshot_file for this snap is: volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-a46ff627-f92e-44ad-a622-62aec488daa6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[258ce532-51c9-42bb-b3d6-24db1a5e58ac]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-a46ff627-f92e-44ad-a622-62aec488daa6" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-a46ff627-f92e-44ad-a622-62aec488daa6" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9859f8f-2cd2-4745-bad8-f201b649a52b]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:14 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a Jul 23 03:35:14 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:15 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 Jul 23 03:35:15 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:15 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a" returned: 0 in 0.355s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16896762-0009-494b-b4c0-dcc59e5123d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[892a0de6-fd75-44b8-b680-f8cd74a5c7b9]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:15 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6" returned: 0 in 0.362s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:15 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6 Jul 23 03:35:15 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:15 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 Jul 23 03:35:15 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:15 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-a46ff627-f92e-44ad-a622-62aec488daa6" returned: 0 in 0.254s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-a46ff627-f92e-44ad-a622-62aec488daa6" released by "delete_volume" :: held 0.680s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3" returned: 0 in 0.396s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:15 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:15 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a Jul 23 03:35:15 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Created reservations ['52061e57-21c4-4164-93fe-b57bcd33b161', 'eccc31ec-ecba-4222-a24d-eb80157eadc7', '33a154c6-a25f-4067-95d2-30100b1dec1d', '7d0c265d-1a60-4c46-b027-eb46e2d0d6eb'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:15 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:15 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:16 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:16 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a" returned: 0 in 0.355s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.261s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Deleted volume successfully. Jul 23 03:35:16 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a Jul 23 03:35:16 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-1cc1ac7e-e9aa-493a-8bde-9136f239dc37 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-a46ff627-f92e-44ad-a622-62aec488daa6-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:16 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3.996ec934-3ea8-49bf-982b-03abe8f1c08a" returned: 0 in 0.262s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-996ec934-3ea8-49bf-982b-03abe8f1c08a" released by "_delete_snapshot" :: held 1.462s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-16896762-0009-494b-b4c0-dcc59e5123d3" released by "delete_snapshot" :: held 1.496s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Created reservations ['f5dbedc8-16f2-4209-acd7-2589890a080e', '2d7c8e63-36ee-4b6d-8e75-7a3b1f385f8c', '7d6a6651-347c-4abf-a69a-cc299f7f51f7', '4ebbcce3-2306-4a23-810a-9b14545de6b8'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:16 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Delete snapshot completed successfully. Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-8f314d50-515f-4376-aab5-17e487bf5c12 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-996ec934-3ea8-49bf-982b-03abe8f1c08a-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (e8b057b2-b04b-4935-9d72-73af648995ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fbcb5d-6d1e-48cc-a0c7-33fd87a617b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fbcb5d-6d1e-48cc-a0c7-33fd87a617b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138021353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e789b5-ce5e-429d-8ff9-7cb090a44030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:16Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225b859c-6392-45f7-be28-1ba568c3c71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225b859c-6392-45f7-be28-1ba568c3c71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b262bd30-ba3e-4239-be74-d04a30fe966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b262bd30-ba3e-4239-be74-d04a30fe966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e789b5-ce5e-429d-8ff9-7cb090a44030', 'volume_name': 'volume-22e789b5-ce5e-429d-8ff9-7cb090a44030', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06c24eb-5d6b-486f-8bdf-25ad7a717ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06c24eb-5d6b-486f-8bdf-25ad7a717ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808d6554-d15e-46ee-850b-e4ca417ccefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:16 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Volume 22e789b5-ce5e-429d-8ff9-7cb090a44030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e789b5-ce5e-429d-8ff9-7cb090a44030', 'volume_size': 1} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138021353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e789b5-ce5e-429d-8ff9-7cb090a44030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:16Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Creating volume 22e789b5-ce5e-429d-8ff9-7cb090a44030 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:16 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:16 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 1073741824 Jul 23 03:35:16 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-16896762-0009-494b-b4c0-dcc59e5123d3-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:16 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 1073741824" returned: 0 in 0.408s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-16896762-0009-494b-b4c0-dcc59e5123d3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-16896762-0009-494b-b4c0-dcc59e5123d3" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-16896762-0009-494b-b4c0-dcc59e5123d3" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:17 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 Jul 23 03:35:17 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[45462575-70d8-4408-b941-a0552c82e3f9]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:17 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 Jul 23 03:35:17 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:17 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030" returned: 0 in 0.248s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808d6554-d15e-46ee-850b-e4ca417ccefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e789b5-ce5e-429d-8ff9-7cb090a44030', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31f76c2-1f88-4ee4-9011-dfdb4612a1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:17 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Volume volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 (22e789b5-ce5e-429d-8ff9-7cb090a44030): created successfully Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31f76c2-1f88-4ee4-9011-dfdb4612a1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (e8b057b2-b04b-4935-9d72-73af648995ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:17 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-55cb1b26-ed6c-4ed1-8188-a078c021466d tempest-ProjectMemberTests-1042172611 None] Created volume successfully. Jul 23 03:35:17 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3" returned: 0 in 0.364s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:17 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3 Jul 23 03:35:17 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] Creating offline snapshot 4d942b21-b212-4c0c-ac04-160fe6294cc5 of volume 22e789b5-ce5e-429d-8ff9-7cb090a44030 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e2229a-94cc-477d-9f10-8d88d5f557d8]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:17 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-16896762-0009-494b-b4c0-dcc59e5123d3" returned: 0 in 0.272s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-16896762-0009-494b-b4c0-dcc59e5123d3" released by "delete_volume" :: held 0.699s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Created reservations ['b50c1631-4ba9-4961-b8fc-ca6b5154c28c', '4c7234ac-cd55-434a-be1e-b2f35f3e2ddb', '5ad9b2d7-7bd3-4338-8996-562963b826e1', 'd4454adb-a856-4ba6-819c-478c1f163677'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:17 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 Jul 23 03:35:17 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:17 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:17 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:17 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:18 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030" returned: 0 in 0.351s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:18 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 1G Jul 23 03:35:18 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:18 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.251s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:18 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Deleted volume successfully. Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-30e58218-33e5-43f9-a930-46ae25bbfa74 tempest-ProjectReaderTests-1070529529 None] Lock "cinder-16896762-0009-494b-b4c0-dcc59e5123d3-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:18 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 1G" returned: 0 in 0.443s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:18 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 Jul 23 03:35:18 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Flow 'volume_create_manager' (6eefacf2-2a7a-4a52-b11f-7a13eac10e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464df073-e1ca-4d9c-b712-f07872bb19ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464df073-e1ca-4d9c-b712-f07872bb19ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090918798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e946b6b-546e-4963-b8f8-c35f11648dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fa428f6cbe4cde82a4a92881320b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:19Z,use_quota=True,user_id='0617e26fccaf4afcbeff0fac8b91f1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8ea209-9568-49a7-bf44-91b7adb91ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8ea209-9568-49a7-bf44-91b7adb91ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdfa0606-3c99-418a-abe6-317fda456a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdfa0606-3c99-418a-abe6-317fda456a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e946b6b-546e-4963-b8f8-c35f11648dba', 'volume_name': 'volume-3e946b6b-546e-4963-b8f8-c35f11648dba', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63626e8f-1ab4-4b97-8f11-ae0391f99fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63626e8f-1ab4-4b97-8f11-ae0391f99fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d7ad54-f9f5-40a7-9389-6ab94e845b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:18 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Volume 3e946b6b-546e-4963-b8f8-c35f11648dba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e946b6b-546e-4963-b8f8-c35f11648dba', 'volume_size': 1} Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:18 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5" returned: 0 in 0.291s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:18 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 is being set with open permissions: ugo+rw Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:18 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 Jul 23 03:35:18 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:18 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:18 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5" returned: 0 in 0.230s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:19 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.info Jul 23 03:35:19 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:19 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.info" returned: 0 in 0.236s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:19 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.info is being set with open permissions: ugo+rw Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:19 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.info Jul 23 03:35:19 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:19 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.info" returned: 0 in 0.253s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090918798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e946b6b-546e-4963-b8f8-c35f11648dba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fa428f6cbe4cde82a4a92881320b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:19Z,use_quota=True,user_id='0617e26fccaf4afcbeff0fac8b91f1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Creating volume 3e946b6b-546e-4963-b8f8-c35f11648dba {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:19 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:19 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba 1073741824 Jul 23 03:35:19 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:19 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-1dc8eb1d-131e-4aa1-be40-8d5c10f3ca6a tempest-ProjectMemberTests-1042172611 None] Create snapshot completed successfully Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-4d942b21-b212-4c0c-ac04-160fe6294cc5-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-4d942b21-b212-4c0c-ac04-160fe6294cc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-22e789b5-ce5e-429d-8ff9-7cb090a44030" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-22e789b5-ce5e-429d-8ff9-7cb090a44030" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-4d942b21-b212-4c0c-ac04-160fe6294cc5" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-4d942b21-b212-4c0c-ac04-160fe6294cc5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Deleting offline snapshot 4d942b21-b212-4c0c-ac04-160fe6294cc5 of volume 22e789b5-ce5e-429d-8ff9-7cb090a44030 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] snapshot_file for this snap is: volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c84f60-30a8-4ed7-9f1c-6ae9b7de9d50]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:19 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 Jul 23 03:35:19 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:19 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:19 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba 1073741824" returned: 0 in 0.437s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:20 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba Jul 23 03:35:20 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:20 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5" returned: 0 in 0.362s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22e789b5-ce5e-429d-8ff9-7cb090a44030(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[380849d1-be3a-4f0a-8784-4d35e7b77def]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:20 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba" returned: 0 in 0.261s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d7ad54-f9f5-40a7-9389-6ab94e845b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e946b6b-546e-4963-b8f8-c35f11648dba', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26590509-3396-4669-951d-161f0548c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:20 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Volume volume-3e946b6b-546e-4963-b8f8-c35f11648dba (3e946b6b-546e-4963-b8f8-c35f11648dba): created successfully Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26590509-3396-4669-951d-161f0548c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Flow 'volume_create_manager' (6eefacf2-2a7a-4a52-b11f-7a13eac10e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:20 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 Jul 23 03:35:20 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:20 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b19bd3ac-1197-48bd-9abb-4b7d995669ed tempest-ProjectReaderTests-1070529529 None] Created volume successfully. Jul 23 03:35:20 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030" returned: 0 in 0.343s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:20 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 Jul 23 03:35:20 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] Creating offline snapshot 677422b8-89d5-4843-b656-27dea2831e4b of volume 3e946b6b-546e-4963-b8f8-c35f11648dba {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1224e29-6db0-4d04-817d-384b9c769e98]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:20 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5" returned: 0 in 0.343s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:20 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba Jul 23 03:35:20 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:20 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5 Jul 23 03:35:20 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:21 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030.4d942b21-b212-4c0c-ac04-160fe6294cc5" returned: 0 in 0.249s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:21 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba" returned: 0 in 0.355s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:21 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b 1G Jul 23 03:35:21 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-4d942b21-b212-4c0c-ac04-160fe6294cc5" released by "_delete_snapshot" :: held 1.406s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-22e789b5-ce5e-429d-8ff9-7cb090a44030" released by "delete_snapshot" :: held 1.428s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Created reservations ['471ba193-fd36-4931-8de3-5649e7271740', 'be4a9df7-46ad-4a58-b56d-5039950d2b64', '3acdbc87-4857-444e-8a62-665d168dced6', '4d016033-3fe6-4694-814f-d8fa001b04b9'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:21 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Delete snapshot completed successfully. Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-032681ab-d057-4e9d-9aa4-26c10dd2df73 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-4d942b21-b212-4c0c-ac04-160fe6294cc5-delete_snapshot" released by "delete_snapshot" :: held 1.559s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:21 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b 1G" returned: 0 in 0.389s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e946b6b-546e-4963-b8f8-c35f11648dba -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:21 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e946b6b-546e-4963-b8f8-c35f11648dba -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b Jul 23 03:35:21 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:21 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e946b6b-546e-4963-b8f8-c35f11648dba -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b" returned: 0 in 0.273s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:21 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b is being set with open permissions: ugo+rw Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:21 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b Jul 23 03:35:21 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-22e789b5-ce5e-429d-8ff9-7cb090a44030-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-22e789b5-ce5e-429d-8ff9-7cb090a44030-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-22e789b5-ce5e-429d-8ff9-7cb090a44030" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-22e789b5-ce5e-429d-8ff9-7cb090a44030" acquired by "delete_volume" :: waited 0.013s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c94f127-7906-45de-91b6-5a345c038c4b]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:22 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b" returned: 0 in 0.265s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:22 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.info Jul 23 03:35:22 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:22 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 Jul 23 03:35:22 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:22 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.info" returned: 0 in 0.243s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:22 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.info is being set with open permissions: ugo+rw Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:22 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.info Jul 23 03:35:22 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:22 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030" returned: 0 in 0.365s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:22 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030 Jul 23 03:35:22 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:22 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.info" returned: 0 in 0.238s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:22 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-352a04cd-b0ea-4956-9023-7dc8b2f37b81 tempest-ProjectReaderTests-1070529529 None] Create snapshot completed successfully Jul 23 03:35:22 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-22e789b5-ce5e-429d-8ff9-7cb090a44030" returned: 0 in 0.242s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-22e789b5-ce5e-429d-8ff9-7cb090a44030" released by "delete_volume" :: held 0.666s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Created reservations ['488eebf1-07d9-407d-a8fe-e81466f8bf21', '68a464f2-820a-4691-b454-79889ff2c7b5', 'b31c9c9c-d9b4-441b-85f4-270693258e4a', '27aea0ff-efb3-4c6a-b72d-7eb2c9a976a2'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:22 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:22 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-677422b8-89d5-4843-b656-27dea2831e4b-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Lock "cinder-677422b8-89d5-4843-b656-27dea2831e4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-3e946b6b-546e-4963-b8f8-c35f11648dba" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-3e946b6b-546e-4963-b8f8-c35f11648dba" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-677422b8-89d5-4843-b656-27dea2831e4b" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-677422b8-89d5-4843-b656-27dea2831e4b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Deleting offline snapshot 677422b8-89d5-4843-b656-27dea2831e4b of volume 3e946b6b-546e-4963-b8f8-c35f11648dba {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:35:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] snapshot_file for this snap is: volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f8f0ec-0ee8-4ab5-ba0a-90122d3ccb25]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:23 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.257s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Deleted volume successfully. Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-9f538c5f-4e54-4b18-ae6c-2833553187f3 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-22e789b5-ce5e-429d-8ff9-7cb090a44030-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:23 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b Jul 23 03:35:23 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:23 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b" returned: 0 in 0.375s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e946b6b-546e-4963-b8f8-c35f11648dba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea70791c-8901-4077-9906-96f82a79de9f]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:23 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba Jul 23 03:35:23 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (1f75923e-1ea5-4da9-a851-ea606e11d9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d864f45-da16-4f1e-b53e-23f789977fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d864f45-da16-4f1e-b53e-23f789977fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022489477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c9a095-920a-45ea-b658-98123baff07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:23Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9bb21b6-a907-4162-b61b-f32c85a8b724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9bb21b6-a907-4162-b61b-f32c85a8b724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3dbd1d-f8a9-478b-90a3-f8023c875802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3dbd1d-f8a9-478b-90a3-f8023c875802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c9a095-920a-45ea-b658-98123baff07c', 'volume_name': 'volume-56c9a095-920a-45ea-b658-98123baff07c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f942cc98-f38d-42f7-81aa-fc80a56e7b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f942cc98-f38d-42f7-81aa-fc80a56e7b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a69899c-deb5-46a1-aa5d-0b75c91e2ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:23 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Volume 56c9a095-920a-45ea-b658-98123baff07c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c9a095-920a-45ea-b658-98123baff07c', 'volume_size': 1} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022489477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c9a095-920a-45ea-b658-98123baff07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:23Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Creating volume 56c9a095-920a-45ea-b658-98123baff07c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:23 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:23 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c 1073741824 Jul 23 03:35:23 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:23 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba" returned: 0 in 0.360s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:23 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b Jul 23 03:35:23 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:24 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c 1073741824" returned: 0 in 0.412s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:24 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c Jul 23 03:35:24 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:24 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b" returned: 0 in 0.378s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:24 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b Jul 23 03:35:24 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:24 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c" returned: 0 in 0.240s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a69899c-deb5-46a1-aa5d-0b75c91e2ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c9a095-920a-45ea-b658-98123baff07c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1825eea-91ae-414a-9396-3398827fc4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:24 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Volume volume-56c9a095-920a-45ea-b658-98123baff07c (56c9a095-920a-45ea-b658-98123baff07c): created successfully Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1825eea-91ae-414a-9396-3398827fc4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (1f75923e-1ea5-4da9-a851-ea606e11d9e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:24 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-cfe3ab37-5eb1-4b85-95d2-eabdfd31491a tempest-ProjectMemberTests-1042172611 None] Created volume successfully. Jul 23 03:35:24 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba.677422b8-89d5-4843-b656-27dea2831e4b" returned: 0 in 0.243s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-677422b8-89d5-4843-b656-27dea2831e4b" released by "_delete_snapshot" :: held 1.461s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-3e946b6b-546e-4963-b8f8-c35f11648dba" released by "delete_snapshot" :: held 1.486s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Created reservations ['9aecaf29-c1f7-4ff1-a533-676e6db56aa6', 'f4222231-60ba-49b5-924d-9b68615f9989', 'badfd634-fd3d-4966-a851-aaa5038cf724', '7b28d335-e0fa-4b84-b702-fb5f29e5ac5b'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:24 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Delete snapshot completed successfully. Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-473d754c-54c1-454e-aae5-fc195537a3fe tempest-ProjectReaderTests-1070529529 None] Lock "cinder-677422b8-89d5-4843-b656-27dea2831e4b-delete_snapshot" released by "delete_snapshot" :: held 1.620s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] Creating offline snapshot 2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 of volume 56c9a095-920a-45ea-b658-98123baff07c {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ebae82-2ee5-4533-840b-5563b3b44ca5]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:24 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c Jul 23 03:35:24 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:25 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-3e946b6b-546e-4963-b8f8-c35f11648dba-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c" returned: 0 in 0.349s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Lock "cinder-3e946b6b-546e-4963-b8f8-c35f11648dba-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:25 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 1G Jul 23 03:35:25 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Acquiring lock "cinder-quobyte-3e946b6b-546e-4963-b8f8-c35f11648dba" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-3e946b6b-546e-4963-b8f8-c35f11648dba" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a129f7ec-48b1-4fdf-a3aa-6defb09be3b7]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:25 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba Jul 23 03:35:25 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:25 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 1G" returned: 0 in 0.399s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c9a095-920a-45ea-b658-98123baff07c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:25 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c9a095-920a-45ea-b658-98123baff07c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 Jul 23 03:35:25 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:25 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba" returned: 0 in 0.386s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:25 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba Jul 23 03:35:25 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:25 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c9a095-920a-45ea-b658-98123baff07c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71" returned: 0 in 0.289s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:25 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 is being set with open permissions: ugo+rw Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:25 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 Jul 23 03:35:25 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:25 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3e946b6b-546e-4963-b8f8-c35f11648dba" returned: 0 in 0.246s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Lock "cinder-quobyte-3e946b6b-546e-4963-b8f8-c35f11648dba" released by "delete_volume" :: held 0.685s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Created reservations ['b26fad55-049d-4729-9a74-3ed11a2080d9', '96b8210f-af5d-476a-b2d2-50152e1c72cf', 'bd66cd0d-e7bc-4157-80f7-7e0f09436def', '778d2094-75bb-480a-9b79-76c0c57734ff'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:25 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:25 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:26 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71" returned: 0 in 0.247s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:26 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.info Jul 23 03:35:26 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:26 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.249s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:26 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Deleted volume successfully. Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-6709ede7-4caf-4ff5-8975-b11f05847b3a tempest-ProjectReaderTests-1070529529 None] Lock "cinder-3e946b6b-546e-4963-b8f8-c35f11648dba-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:26 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.info" returned: 0 in 0.275s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:26 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.info is being set with open permissions: ugo+rw Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:26 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.info Jul 23 03:35:26 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:26 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.info" returned: 0 in 0.249s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:26 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-42d216c9-3c85-450c-8d32-79b0b8aeafc7 tempest-ProjectMemberTests-1042172611 None] Create snapshot completed successfully Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-2de94ee5-f35f-48e7-8a4e-315d0aa4fa71-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-2de94ee5-f35f-48e7-8a4e-315d0aa4fa71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-56c9a095-920a-45ea-b658-98123baff07c" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-56c9a095-920a-45ea-b658-98123baff07c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-2de94ee5-f35f-48e7-8a4e-315d0aa4fa71" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-2de94ee5-f35f-48e7-8a4e-315d0aa4fa71" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Deleting offline snapshot 2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 of volume 56c9a095-920a-45ea-b658-98123baff07c {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] snapshot_file for this snap is: volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3d5154-19ae-4e48-9b39-e8783cf172b3]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:27 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 Jul 23 03:35:27 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:27 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71" returned: 0 in 0.369s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:27 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c9a095-920a-45ea-b658-98123baff07c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:35:27 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94a3930-1cad-4315-9697-2ef1cba8f9f4]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:27 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c Jul 23 03:35:27 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:27 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c" returned: 0 in 0.399s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:27 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 Jul 23 03:35:27 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:28 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71" returned: 0 in 0.367s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:28 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71 Jul 23 03:35:28 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:28 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c.2de94ee5-f35f-48e7-8a4e-315d0aa4fa71" returned: 0 in 0.262s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-2de94ee5-f35f-48e7-8a4e-315d0aa4fa71" released by "_delete_snapshot" :: held 1.499s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-56c9a095-920a-45ea-b658-98123baff07c" released by "delete_snapshot" :: held 1.524s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:28 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Created reservations ['27310ceb-3c2c-4be2-8c36-d5abcf99da7f', '3b486831-8043-47b5-abd2-3402034006c8', 'd66cf675-0f3a-4162-b159-fcdcbb2dcf90', '74b626fc-ce52-4837-a85f-26845180170e'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:28 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Delete snapshot completed successfully. Jul 23 03:35:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e8a84705-f866-48b9-b100-685d5d7951f6 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-2de94ee5-f35f-48e7-8a4e-315d0aa4fa71-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-56c9a095-920a-45ea-b658-98123baff07c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-56c9a095-920a-45ea-b658-98123baff07c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-56c9a095-920a-45ea-b658-98123baff07c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-56c9a095-920a-45ea-b658-98123baff07c" acquired by "delete_volume" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b301dd-3404-405f-b4a9-02d3a24ef1cd]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:29 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c Jul 23 03:35:29 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:29 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c" returned: 0 in 0.361s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:29 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c Jul 23 03:35:29 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:29 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-56c9a095-920a-45ea-b658-98123baff07c" returned: 0 in 0.250s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-56c9a095-920a-45ea-b658-98123baff07c" released by "delete_volume" :: held 0.671s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Created reservations ['e6200af8-a79f-4ef8-a8d0-9008337f7222', '9f75580a-1787-491a-9a19-80b7ef4af52d', '23ad9ec1-9748-4d2b-a83c-69aebbc9342b', '884865d7-2275-4d11-9e02-7d198c43cf43'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:29 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:29 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:29 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:30 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.238s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:30 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Deleted volume successfully. Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-2c61a9ee-6f08-42d0-af92-b0b572760707 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-56c9a095-920a-45ea-b658-98123baff07c-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (914bcd8f-c618-4cd2-96ba-5992b1a764e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b141652a-fa06-4f9b-bd9b-be2b15ec3f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b141652a-fa06-4f9b-bd9b-be2b15ec3f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850100403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b6c5f8-e0c8-44dd-934e-b41d0bec8f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:31Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98df4415-d351-4d4f-bb6f-16c17adf340a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98df4415-d351-4d4f-bb6f-16c17adf340a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34327670-67a1-4980-a085-8b7e40fa6531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34327670-67a1-4980-a085-8b7e40fa6531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b6c5f8-e0c8-44dd-934e-b41d0bec8f77', 'volume_name': 'volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66d7954-acec-49c2-8ffb-a8e75fee2f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66d7954-acec-49c2-8ffb-a8e75fee2f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc2ad4f-f559-4cd0-bde2-aea1f47ed1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:30 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Volume 29b6c5f8-e0c8-44dd-934e-b41d0bec8f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77', 'volume_size': 1} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850100403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b6c5f8-e0c8-44dd-934e-b41d0bec8f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:31Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Creating volume 29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:30 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:30 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:30 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 1073741824 Jul 23 03:35:30 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:31 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 1073741824" returned: 0 in 0.425s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:31 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 Jul 23 03:35:31 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:31 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77" returned: 0 in 0.250s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc2ad4f-f559-4cd0-bde2-aea1f47ed1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e438b0cf-03a8-4809-b267-ae7b4cb87bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:31 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Volume volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 (29b6c5f8-e0c8-44dd-934e-b41d0bec8f77): created successfully Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e438b0cf-03a8-4809-b267-ae7b4cb87bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (914bcd8f-c618-4cd2-96ba-5992b1a764e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:31 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-4e2301ee-d630-4a9c-8f28-d636b5998e08 tempest-ProjectMemberTests-1042172611 None] Created volume successfully. Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:31 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] Creating offline snapshot 9e3805ea-80fb-4938-9a75-1bfb0755369a of volume 29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:35:32 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc44137b-c803-4821-9f97-bd78376ad1d6]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:32 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 Jul 23 03:35:32 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:32 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77" returned: 0 in 0.341s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:32 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a 1G Jul 23 03:35:32 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:32 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a 1G" returned: 0 in 0.360s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:32 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:32 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a Jul 23 03:35:32 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:33 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a" returned: 0 in 0.287s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:33 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a is being set with open permissions: ugo+rw Jul 23 03:35:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:33 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a Jul 23 03:35:33 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:33 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a" returned: 0 in 0.256s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:33 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.info Jul 23 03:35:33 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:33 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.info" returned: 0 in 0.260s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:33 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.info is being set with open permissions: ugo+rw Jul 23 03:35:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:33 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.info Jul 23 03:35:33 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:33 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.info" returned: 0 in 0.239s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:33 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:33 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-7f7abd91-55b5-4e03-8b02-738c2ffaf806 tempest-ProjectMemberTests-1042172611 None] Create snapshot completed successfully Jul 23 03:35:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-9e3805ea-80fb-4938-9a75-1bfb0755369a-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-9e3805ea-80fb-4938-9a75-1bfb0755369a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-9e3805ea-80fb-4938-9a75-1bfb0755369a" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:34 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-9e3805ea-80fb-4938-9a75-1bfb0755369a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Deleting offline snapshot 9e3805ea-80fb-4938-9a75-1bfb0755369a of volume 29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:35:34 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] snapshot_file for this snap is: volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:35:34 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea3bb92-7ead-45b4-92d0-abec0659f442]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:34 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:35 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a Jul 23 03:35:35 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:35 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a" returned: 0 in 0.356s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:35 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:35:35 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcaa016-0271-40db-8b0e-02f88feb8cb2]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:35 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 Jul 23 03:35:35 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:35 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77" returned: 0 in 0.369s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:35 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:35 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a Jul 23 03:35:35 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:36 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a" returned: 0 in 0.352s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:36 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a Jul 23 03:35:36 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:36 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:36 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77.9e3805ea-80fb-4938-9a75-1bfb0755369a" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-9e3805ea-80fb-4938-9a75-1bfb0755369a" released by "_delete_snapshot" :: held 1.432s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77" released by "delete_snapshot" :: held 1.454s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:36 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Created reservations ['93d9313b-4ab3-496d-a788-b8448e508e5a', '7555675d-6ab0-40e4-a5ca-d9bc75a302ff', '9d2cc880-df2c-40a0-aa91-4122dd99cbe4', 'e900f007-3a1d-4143-9006-9916303a0721'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:36 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Delete snapshot completed successfully. Jul 23 03:35:36 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-def3ddf0-0679-4f36-b927-38213e273242 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-9e3805ea-80fb-4938-9a75-1bfb0755369a-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:37 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccfdd09-8cea-4fc5-90e7-a6f249a98ad0]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:37 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 Jul 23 03:35:37 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:37 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77" returned: 0 in 0.381s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:37 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77 Jul 23 03:35:37 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:37 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:37 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77" returned: 0 in 0.244s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:37 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77" released by "delete_volume" :: held 0.700s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:37 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Created reservations ['68d09963-843b-41ca-8bec-8edd187c53b6', '37d89795-5be0-4afe-9f75-73f11bfc6bfe', '287e77b1-84ce-49b0-8ecb-0a8b85c23c73', 'ec635557-f659-4232-894c-9ffaf5c31e78'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:38 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:38 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:38 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.260s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:38 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Deleted volume successfully. Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5c6c93f4-0713-4023-9afc-86771524b670 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-29b6c5f8-e0c8-44dd-934e-b41d0bec8f77-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Flow 'volume_create_manager' (500e4771-3dc4-4016-9507-cbdd6a53fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:38 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b8dede-18e2-4949-be14-2b7d5a37281a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b8dede-18e2-4949-be14-2b7d5a37281a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1051596465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cbfc50-9e45-449d-9073-8011c260dde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990774f7dec04e60a87f2813240b6dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:39Z,use_quota=True,user_id='00e2e3e43f5c45f6935eda9b35c6a0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f226285-901e-4149-9467-82f148144057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f226285-901e-4149-9467-82f148144057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7abdf19-b40c-4c91-9e47-2cbc1ab6eadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7abdf19-b40c-4c91-9e47-2cbc1ab6eadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1cbfc50-9e45-449d-9073-8011c260dde5', 'volume_name': 'volume-b1cbfc50-9e45-449d-9073-8011c260dde5', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592bd04c-ddb4-4d04-a394-9a05f9bbe88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592bd04c-ddb4-4d04-a394-9a05f9bbe88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85614349-d407-42c6-8388-bb6ae94575c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Volume b1cbfc50-9e45-449d-9073-8011c260dde5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1cbfc50-9e45-449d-9073-8011c260dde5', 'volume_size': 1} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1051596465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cbfc50-9e45-449d-9073-8011c260dde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990774f7dec04e60a87f2813240b6dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:39Z,use_quota=True,user_id='00e2e3e43f5c45f6935eda9b35c6a0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Creating volume b1cbfc50-9e45-449d-9073-8011c260dde5 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:39 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:39 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5 1073741824 Jul 23 03:35:39 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (f8f16185-c15b-4550-af89-f83bff01e208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f185ae8-3c05-40d5-9af2-d17545d9ceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f185ae8-3c05-40d5-9af2-d17545d9ceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429946539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a946c40-d71f-4841-ba75-7e2e3207659c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:39Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d715de44-8c0d-4374-ab6b-80cf2bd27c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d715de44-8c0d-4374-ab6b-80cf2bd27c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129733a2-8f5e-4964-81f4-d7fae33fa0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129733a2-8f5e-4964-81f4-d7fae33fa0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a946c40-d71f-4841-ba75-7e2e3207659c', 'volume_name': 'volume-3a946c40-d71f-4841-ba75-7e2e3207659c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32066c8-8eb4-4af4-ad6d-89b706aec530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32066c8-8eb4-4af4-ad6d-89b706aec530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ef0c1f-8bcf-4bca-9259-0ca6790b2f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Volume 3a946c40-d71f-4841-ba75-7e2e3207659c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a946c40-d71f-4841-ba75-7e2e3207659c', 'volume_size': 1} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:39 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5 1073741824" returned: 0 in 0.457s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:39 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5 Jul 23 03:35:39 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:39 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5" returned: 0 in 0.235s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429946539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a946c40-d71f-4841-ba75-7e2e3207659c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:39Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Creating volume 3a946c40-d71f-4841-ba75-7e2e3207659c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:39 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85614349-d407-42c6-8388-bb6ae94575c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1cbfc50-9e45-449d-9073-8011c260dde5', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22795a60-95cc-4bfd-bc01-4e2d3354399c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:39 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c 1073741824 Jul 23 03:35:39 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:39 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Volume volume-b1cbfc50-9e45-449d-9073-8011c260dde5 (b1cbfc50-9e45-449d-9073-8011c260dde5): created successfully Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22795a60-95cc-4bfd-bc01-4e2d3354399c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:39 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Flow 'volume_create_manager' (500e4771-3dc4-4016-9507-cbdd6a53fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:39 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-127c8acf-7990-45a4-a9ef-be539b63cdf8 tempest-ProjectReaderTests-1288543785 None] Created volume successfully. Jul 23 03:35:40 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c 1073741824" returned: 0 in 0.415s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:40 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c Jul 23 03:35:40 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:40 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c" returned: 0 in 0.240s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:40 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:40 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ef0c1f-8bcf-4bca-9259-0ca6790b2f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a946c40-d71f-4841-ba75-7e2e3207659c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd386103-985f-414d-b8ab-4ae29d9256ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:40 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Volume volume-3a946c40-d71f-4841-ba75-7e2e3207659c (3a946c40-d71f-4841-ba75-7e2e3207659c): created successfully Jul 23 03:35:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd386103-985f-414d-b8ab-4ae29d9256ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:40 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (f8f16185-c15b-4550-af89-f83bff01e208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:40 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-17b19ebc-4680-4ae4-88e5-e22835cd0e86 tempest-ProjectMemberTests-1042172611 None] Created volume successfully. Jul 23 03:35:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Acquiring lock "cinder-b1cbfc50-9e45-449d-9073-8011c260dde5-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:40 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Lock "cinder-b1cbfc50-9e45-449d-9073-8011c260dde5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Acquiring lock "cinder-quobyte-b1cbfc50-9e45-449d-9073-8011c260dde5" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Lock "cinder-quobyte-b1cbfc50-9e45-449d-9073-8011c260dde5" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] Creating offline snapshot 3d69cdc3-a307-4ee7-b1a4-6bf68772a42f of volume 3a946c40-d71f-4841-ba75-7e2e3207659c {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60e0cf0-b345-4e79-9e31-b349b9781466]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6adf53-0c2b-4353-90f9-522297e91b52]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:41 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5 Jul 23 03:35:41 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:41 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c Jul 23 03:35:41 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:41 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5" returned: 0 in 0.357s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:41 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c" returned: 0 in 0.356s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:41 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5 Jul 23 03:35:41 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:41 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f 1G Jul 23 03:35:41 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:41 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-b1cbfc50-9e45-449d-9073-8011c260dde5" returned: 0 in 0.239s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Lock "cinder-quobyte-b1cbfc50-9e45-449d-9073-8011c260dde5" released by "delete_volume" :: held 0.634s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Created reservations ['ded761d9-a701-4406-83ac-eb22fbe9f341', '5393e94e-3e58-449a-b234-6a5d1c064216', '8800eab5-878e-4fc1-ad79-5a496ed929a7', '2af709e0-ab96-4cf7-9b2c-8a9392e0d127'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:41 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:41 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:41 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f 1G" returned: 0 in 0.463s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:41 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a946c40-d71f-4841-ba75-7e2e3207659c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:41 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a946c40-d71f-4841-ba75-7e2e3207659c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f Jul 23 03:35:41 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:42 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.286s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:42 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Deleted volume successfully. Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c14a0426-0934-423c-9cab-0e8e2270675f tempest-ProjectReaderTests-1288543785 None] Lock "cinder-b1cbfc50-9e45-449d-9073-8011c260dde5-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:42 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a946c40-d71f-4841-ba75-7e2e3207659c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f" returned: 0 in 0.335s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:42 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f is being set with open permissions: ugo+rw Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:42 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f Jul 23 03:35:42 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:42 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f" returned: 0 in 0.249s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:42 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.info Jul 23 03:35:42 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Flow 'volume_create_manager' (139d18f6-41d9-4060-9da6-ea233c012148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c9f293-bc1d-4aad-9e48-97cd7beffd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c9f293-bc1d-4aad-9e48-97cd7beffd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913400715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e281b99-fd83-4d49-93b2-be06b2bbf814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990774f7dec04e60a87f2813240b6dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:43Z,use_quota=True,user_id='00e2e3e43f5c45f6935eda9b35c6a0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e04239c-e82a-4c93-bc7b-76e3e91ef1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e04239c-e82a-4c93-bc7b-76e3e91ef1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36a857b-ca3e-4806-bd33-593c296238d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36a857b-ca3e-4806-bd33-593c296238d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e281b99-fd83-4d49-93b2-be06b2bbf814', 'volume_name': 'volume-1e281b99-fd83-4d49-93b2-be06b2bbf814', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a10b308-e2dc-42b1-8575-ea357a4339b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a10b308-e2dc-42b1-8575-ea357a4339b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c66491-e312-497b-a53f-f2f1dbdb143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:42 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Volume 1e281b99-fd83-4d49-93b2-be06b2bbf814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e281b99-fd83-4d49-93b2-be06b2bbf814', 'volume_size': 1} Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:42 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.info" returned: 0 in 0.241s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:42 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.info is being set with open permissions: ugo+rw Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:42 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.info Jul 23 03:35:42 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:42 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:42 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.info" returned: 0 in 0.243s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.346s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913400715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e281b99-fd83-4d49-93b2-be06b2bbf814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='990774f7dec04e60a87f2813240b6dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:43Z,use_quota=True,user_id='00e2e3e43f5c45f6935eda9b35c6a0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Creating volume 1e281b99-fd83-4d49-93b2-be06b2bbf814 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:43 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:43 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814 1073741824 Jul 23 03:35:43 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:43 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-cf334fdc-2f98-4a04-b63d-9f99d46d8a80 tempest-ProjectMemberTests-1042172611 None] Create snapshot completed successfully Jul 23 03:35:43 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814 1073741824" returned: 0 in 0.395s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:43 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814 Jul 23 03:35:43 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:43 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814" returned: 0 in 0.261s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c66491-e312-497b-a53f-f2f1dbdb143a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e281b99-fd83-4d49-93b2-be06b2bbf814', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7972b924-b8e8-4628-96f9-1fe896094742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:43 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Volume volume-1e281b99-fd83-4d49-93b2-be06b2bbf814 (1e281b99-fd83-4d49-93b2-be06b2bbf814): created successfully Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7972b924-b8e8-4628-96f9-1fe896094742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:43 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Flow 'volume_create_manager' (139d18f6-41d9-4060-9da6-ea233c012148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:43 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-60d93500-99e5-4e6f-8c48-2c9e6f3561cc tempest-ProjectReaderTests-1288543785 None] Created volume successfully. Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-3d69cdc3-a307-4ee7-b1a4-6bf68772a42f-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-3d69cdc3-a307-4ee7-b1a4-6bf68772a42f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-3a946c40-d71f-4841-ba75-7e2e3207659c" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-3a946c40-d71f-4841-ba75-7e2e3207659c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-3d69cdc3-a307-4ee7-b1a4-6bf68772a42f" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-3d69cdc3-a307-4ee7-b1a4-6bf68772a42f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Deleting offline snapshot 3d69cdc3-a307-4ee7-b1a4-6bf68772a42f of volume 3a946c40-d71f-4841-ba75-7e2e3207659c {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] snapshot_file for this snap is: volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa7de2a-85ea-4d3a-a7d7-5129d2613a54]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:44 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f Jul 23 03:35:44 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:44 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f" returned: 0 in 0.359s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a946c40-d71f-4841-ba75-7e2e3207659c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9636f7-5d7a-4215-8dc8-4b047b0c2f67]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Acquiring lock "cinder-1e281b99-fd83-4d49-93b2-be06b2bbf814-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Lock "cinder-1e281b99-fd83-4d49-93b2-be06b2bbf814-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Acquiring lock "cinder-quobyte-1e281b99-fd83-4d49-93b2-be06b2bbf814" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:44 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c Jul 23 03:35:44 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Lock "cinder-quobyte-1e281b99-fd83-4d49-93b2-be06b2bbf814" acquired by "delete_volume" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0506d83-ae5e-40e4-8cc3-caf274c61a65]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:44 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:44 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814 Jul 23 03:35:44 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:45 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c" returned: 0 in 0.359s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:45 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f Jul 23 03:35:45 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:45 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814" returned: 0 in 0.354s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:45 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814 Jul 23 03:35:45 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:45 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f" returned: 0 in 0.351s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:45 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f Jul 23 03:35:45 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1e281b99-fd83-4d49-93b2-be06b2bbf814" returned: 0 in 0.243s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Lock "cinder-quobyte-1e281b99-fd83-4d49-93b2-be06b2bbf814" released by "delete_volume" :: held 0.643s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Created reservations ['3d152b23-8eb6-49f9-9feb-e1823fe54bb9', '2b93e690-321c-43cb-b405-425519d5ce10', '68c5a948-4468-4b33-a952-259ea551b58a', '0ddd90af-af41-460b-af8b-3bde0df87886'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:45 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:45 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:45 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c.3d69cdc3-a307-4ee7-b1a4-6bf68772a42f" returned: 0 in 0.252s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-3d69cdc3-a307-4ee7-b1a4-6bf68772a42f" released by "_delete_snapshot" :: held 1.421s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-3a946c40-d71f-4841-ba75-7e2e3207659c" released by "delete_snapshot" :: held 1.447s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Created reservations ['5c7f5410-4f21-4890-a7b5-a6be366a2ad4', '1f9385bc-2226-426e-acb0-dd60ac6e2723', '2d6226b7-35b8-4a6b-b76a-d5e02150a86c', 'e92f29e5-b81d-4850-8ffa-ae038de8ac67'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Delete snapshot completed successfully. Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-f59ee272-1967-4673-9c3c-319f62efb4cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-3d69cdc3-a307-4ee7-b1a4-6bf68772a42f-delete_snapshot" released by "delete_snapshot" :: held 1.588s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:45 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.255s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:45 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Deleted volume successfully. Jul 23 03:35:45 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-24f469b5-ee17-437d-b924-5dfd60304880 tempest-ProjectReaderTests-1288543785 None] Lock "cinder-1e281b99-fd83-4d49-93b2-be06b2bbf814-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-3a946c40-d71f-4841-ba75-7e2e3207659c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-3a946c40-d71f-4841-ba75-7e2e3207659c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-3a946c40-d71f-4841-ba75-7e2e3207659c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:46 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-3a946c40-d71f-4841-ba75-7e2e3207659c" acquired by "delete_volume" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:46 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[504990d5-2f83-4ab2-8e96-b67ff91bfe94]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:46 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c Jul 23 03:35:46 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:46 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c" returned: 0 in 0.388s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:46 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:46 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c Jul 23 03:35:46 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:47 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-3a946c40-d71f-4841-ba75-7e2e3207659c" returned: 0 in 0.260s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-3a946c40-d71f-4841-ba75-7e2e3207659c" released by "delete_volume" :: held 0.729s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Created reservations ['e1d821d7-80fd-4c3b-a710-81378ed93ed0', 'd1db6021-b6d3-491f-adb4-f9ea2d8646ae', '50758170-4921-4d63-8b37-cf8b676efff4', 'b30b8596-0454-4a60-b153-719bebbbb6b0'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:47 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:47 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:47 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.263s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:47 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Deleted volume successfully. Jul 23 03:35:47 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-0bf210ef-0b36-494d-86f9-af4b13b46b15 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-3a946c40-d71f-4841-ba75-7e2e3207659c-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (b8c80474-f97b-4d5e-96be-49affa8b68cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25beeba8-2e90-47c1-9fa1-c5116a3edd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25beeba8-2e90-47c1-9fa1-c5116a3edd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327648657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bfb892-1da0-4fc0-90f5-78f93d652cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:48Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad5f9d3-78d8-4549-8b01-440c5811485c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad5f9d3-78d8-4549-8b01-440c5811485c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a30c52e-2431-4ba3-94a8-b61fa7444450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a30c52e-2431-4ba3-94a8-b61fa7444450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bfb892-1da0-4fc0-90f5-78f93d652cfc', 'volume_name': 'volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d053083-3241-4597-b27f-c239b325312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d053083-3241-4597-b27f-c239b325312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f609ad5-8f37-49d0-80b5-b8f1001081d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:48 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Volume 94bfb892-1da0-4fc0-90f5-78f93d652cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc', 'volume_size': 1} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327648657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bfb892-1da0-4fc0-90f5-78f93d652cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:48Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Creating volume 94bfb892-1da0-4fc0-90f5-78f93d652cfc {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:48 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:48 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc 1073741824 Jul 23 03:35:48 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:48 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc 1073741824" returned: 0 in 0.459s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:48 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc Jul 23 03:35:48 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:48 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc" returned: 0 in 0.273s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f609ad5-8f37-49d0-80b5-b8f1001081d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedc19a0-001e-4aa5-abab-b8b1b26ab845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:48 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Volume volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc (94bfb892-1da0-4fc0-90f5-78f93d652cfc): created successfully Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedc19a0-001e-4aa5-abab-b8b1b26ab845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:48 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (b8c80474-f97b-4d5e-96be-49affa8b68cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:49 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-712024c4-d17f-4443-8dbf-f64a93f793e5 tempest-ProjectMemberTests-1042172611 None] Created volume successfully. Jul 23 03:35:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:50 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] Creating offline snapshot 0345da23-59c8-42e6-83f8-dbef485fd13b of volume 94bfb892-1da0-4fc0-90f5-78f93d652cfc {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:35:50 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[e924a55e-d3e4-4d12-8a08-b0c8d878b599]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:50 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc Jul 23 03:35:50 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:50 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc" returned: 0 in 0.422s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:50 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:50 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b 1G Jul 23 03:35:50 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:51 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b 1G" returned: 0 in 0.429s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:51 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b Jul 23 03:35:51 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:51 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b" returned: 0 in 0.293s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:51 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b is being set with open permissions: ugo+rw Jul 23 03:35:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:51 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b Jul 23 03:35:51 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:51 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:51 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:51 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.info Jul 23 03:35:51 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:52 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.info" returned: 0 in 0.269s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:52 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.info is being set with open permissions: ugo+rw Jul 23 03:35:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:52 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.info Jul 23 03:35:52 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:52 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.info" returned: 0 in 0.263s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:52 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:52 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f97b4416-fdf5-4ef4-b773-ae07cf079420 tempest-ProjectMemberTests-1042172611 None] Create snapshot completed successfully Jul 23 03:35:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-0345da23-59c8-42e6-83f8-dbef485fd13b-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-0345da23-59c8-42e6-83f8-dbef485fd13b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-94bfb892-1da0-4fc0-90f5-78f93d652cfc" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-94bfb892-1da0-4fc0-90f5-78f93d652cfc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-0345da23-59c8-42e6-83f8-dbef485fd13b" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:53 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-0345da23-59c8-42e6-83f8-dbef485fd13b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Deleting offline snapshot 0345da23-59c8-42e6-83f8-dbef485fd13b of volume 94bfb892-1da0-4fc0-90f5-78f93d652cfc {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:35:53 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] snapshot_file for this snap is: volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:35:53 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfd82e7-10fc-4946-abd1-ccd10f036628]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:53 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:53 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b Jul 23 03:35:53 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:54 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b" returned: 0 in 0.376s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:54 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:35:54 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9961f763-32fd-40f7-aab9-1ab5700ecc90]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:54 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc Jul 23 03:35:54 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:54 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc" returned: 0 in 0.372s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:54 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b Jul 23 03:35:54 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:54 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b" returned: 0 in 0.388s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:54 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:54 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b Jul 23 03:35:54 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:55 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc.0345da23-59c8-42e6-83f8-dbef485fd13b" returned: 0 in 0.253s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-0345da23-59c8-42e6-83f8-dbef485fd13b" released by "_delete_snapshot" :: held 1.504s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-94bfb892-1da0-4fc0-90f5-78f93d652cfc" released by "delete_snapshot" :: held 1.527s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:55 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Created reservations ['df7e183c-5e9d-4460-8811-44f4a00e2d15', '338602ff-aeb0-496d-b6e0-aca85ff93eb4', '70e6d98e-8559-4996-b44b-b72124913db9', '55b982ba-3d90-4b8e-b92b-2ceea1ac43a5'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:55 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Delete snapshot completed successfully. Jul 23 03:35:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-84e61502-cd4a-4628-a58f-9dd17c09b8cc tempest-ProjectMemberTests-1042172611 None] Lock "cinder-0345da23-59c8-42e6-83f8-dbef485fd13b-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-94bfb892-1da0-4fc0-90f5-78f93d652cfc-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-94bfb892-1da0-4fc0-90f5-78f93d652cfc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-94bfb892-1da0-4fc0-90f5-78f93d652cfc" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:35:55 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-94bfb892-1da0-4fc0-90f5-78f93d652cfc" acquired by "delete_volume" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:35:55 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ec76fd-5eef-4588-99ca-9bd68600c377]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:55 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:56 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc Jul 23 03:35:56 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:56 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc" returned: 0 in 0.378s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:56 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc Jul 23 03:35:56 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:56 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-94bfb892-1da0-4fc0-90f5-78f93d652cfc" returned: 0 in 0.288s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-94bfb892-1da0-4fc0-90f5-78f93d652cfc" released by "delete_volume" :: held 0.735s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=232,cinder:SELECT=183,cinder:DELETE=15,cinder:INSERT=53 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Created reservations ['dff5e87f-aaa9-4638-a5ca-dd1e8c93572b', '7fc5ad60-8306-4e4a-b71c-779f18ec675b', '7f7d08dd-01b7-4045-8ba3-1fbffe382fa0', '954018b4-c3fa-4a50-b160-57336f7728ea'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:DELETE=22,cinder:UPDATE=209,cinder:INSERT=69,cinder:SELECT=155 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:56 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:56 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:35:56 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:56 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.276s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:35:57 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Deleted volume successfully. Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-bac8ce44-7aeb-4c88-a5e6-25b758343743 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-94bfb892-1da0-4fc0-90f5-78f93d652cfc-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (28e7c33c-7a91-4b0a-9de3-34a59c29c365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fefbb8-34bf-4c5a-93ac-9f681aff2449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fefbb8-34bf-4c5a-93ac-9f681aff2449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1697525904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd7abce-11b1-417b-bb22-50089fe0b6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:57Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54b0e0e-d977-48bc-b7f0-b07293a11b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54b0e0e-d977-48bc-b7f0-b07293a11b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06255c68-b879-48f3-b931-19340e707583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06255c68-b879-48f3-b931-19340e707583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd7abce-11b1-417b-bb22-50089fe0b6a1', 'volume_name': 'volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dcaf1f2-a600-423d-a7ee-6f7e90e734d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dcaf1f2-a600-423d-a7ee-6f7e90e734d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a28837e-4939-45dc-bc66-fe85a8ed18cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:57 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Volume 1fd7abce-11b1-417b-bb22-50089fe0b6a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1', 'volume_size': 1} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1697525904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd7abce-11b1-417b-bb22-50089fe0b6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:35:57Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Creating volume 1fd7abce-11b1-417b-bb22-50089fe0b6a1 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:35:57 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:35:57 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:57 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 1073741824 Jul 23 03:35:57 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:58 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 1073741824" returned: 0 in 0.539s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:58 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 Jul 23 03:35:58 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:35:58 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 23 03:35:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1" returned: 0 in 0.297s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:35:58 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:35:58 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:35:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a28837e-4939-45dc-bc66-fe85a8ed18cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa351fd-c94f-43b6-bbcc-a9b179b52444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:35:58 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Volume volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 (1fd7abce-11b1-417b-bb22-50089fe0b6a1): created successfully Jul 23 03:35:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa351fd-c94f-43b6-bbcc-a9b179b52444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:35:58 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (28e7c33c-7a91-4b0a-9de3-34a59c29c365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:35:58 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-a25c6433-feb0-4f6d-a851-f307464b27a2 tempest-ProjectMemberTests-1042172611 None] Created volume successfully. Jul 23 03:35:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:35:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:35:59 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] Creating offline snapshot 69fb2524-16c0-4465-bf5a-bc0aa804afd5 of volume 1fd7abce-11b1-417b-bb22-50089fe0b6a1 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:35:59 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaddc0a-5bdc-4f80-bfe5-1bf01e6a1115]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:35:59 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:35:59 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 Jul 23 03:35:59 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:00 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1" returned: 0 in 0.408s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:00 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 1G Jul 23 03:36:00 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:00 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 1G" returned: 0 in 0.474s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:00 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 Jul 23 03:36:00 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:00 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5" returned: 0 in 0.307s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:00 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 is being set with open permissions: ugo+rw Jul 23 03:36:00 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:01 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 Jul 23 03:36:01 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:01 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5" returned: 0 in 0.238s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:01 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.info Jul 23 03:36:01 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:01 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.info" returned: 0 in 0.262s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:01 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.info is being set with open permissions: ugo+rw Jul 23 03:36:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:01 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.info Jul 23 03:36:01 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:01 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.info" returned: 0 in 0.246s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:01 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:01 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e3bf89e3-a4de-4335-8f9a-b39736024cfb tempest-ProjectMemberTests-1042172611 None] Create snapshot completed successfully Jul 23 03:36:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-69fb2524-16c0-4465-bf5a-bc0aa804afd5-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-69fb2524-16c0-4465-bf5a-bc0aa804afd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-1fd7abce-11b1-417b-bb22-50089fe0b6a1" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-1fd7abce-11b1-417b-bb22-50089fe0b6a1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-69fb2524-16c0-4465-bf5a-bc0aa804afd5" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:02 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-69fb2524-16c0-4465-bf5a-bc0aa804afd5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Deleting offline snapshot 69fb2524-16c0-4465-bf5a-bc0aa804afd5 of volume 1fd7abce-11b1-417b-bb22-50089fe0b6a1 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:02 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] snapshot_file for this snap is: volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:02 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[f120c488-2a0e-4aa3-8d94-2c3c170f5206]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:02 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:03 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 Jul 23 03:36:03 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:03 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5" returned: 0 in 0.367s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:03 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:03 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0b3320-8042-4c48-afb7-6cadf3e9ad47]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:03 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 Jul 23 03:36:03 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:03 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1" returned: 0 in 0.488s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:03 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:03 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 Jul 23 03:36:03 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:04 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5" returned: 0 in 0.391s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:04 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5 Jul 23 03:36:04 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:04 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:04 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1.69fb2524-16c0-4465-bf5a-bc0aa804afd5" returned: 0 in 0.274s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-69fb2524-16c0-4465-bf5a-bc0aa804afd5" released by "_delete_snapshot" :: held 1.627s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-1fd7abce-11b1-417b-bb22-50089fe0b6a1" released by "delete_snapshot" :: held 1.651s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:04 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Created reservations ['b849ce48-f2c3-45ae-8bd7-963c9626b0d0', '5836e3dd-1b9d-4f15-9644-e5fe16dc270d', '2220fb96-6ac0-4f60-9ab1-0711146dceeb', 'e19ee2e9-1725-4026-a066-4b83f753e77b'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:04 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Delete snapshot completed successfully. Jul 23 03:36:04 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-e31d57ef-7fee-4242-8fbf-fc54629eeaf4 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-69fb2524-16c0-4465-bf5a-bc0aa804afd5-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-1fd7abce-11b1-417b-bb22-50089fe0b6a1-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Lock "cinder-1fd7abce-11b1-417b-bb22-50089fe0b6a1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-1fd7abce-11b1-417b-bb22-50089fe0b6a1" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:05 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-1fd7abce-11b1-417b-bb22-50089fe0b6a1" acquired by "delete_volume" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:05 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[0292ad1c-8689-4e9d-ac62-f9c8ad4333dc]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:05 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 Jul 23 03:36:05 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:05 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1" returned: 0 in 0.448s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:05 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:05 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1 Jul 23 03:36:05 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:06 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-1fd7abce-11b1-417b-bb22-50089fe0b6a1" returned: 0 in 0.280s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-1fd7abce-11b1-417b-bb22-50089fe0b6a1" released by "delete_volume" :: held 0.811s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Created reservations ['6f90bfc7-823c-4ea7-9bb3-317466d10857', '0ab14c85-e95e-4bd9-8ef5-fbd9bd145024', '27eaf688-2114-4dbc-b8bc-0738ac32ae53', '169c10da-26c8-4911-8e0c-4004353d931d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:06 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:36:06 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:06 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.294s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:06 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Deleted volume successfully. Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b1e9f988-df30-4c68-b0fb-d8c8b7268adf tempest-ProjectMemberTests-1042172611 None] Lock "cinder-1fd7abce-11b1-417b-bb22-50089fe0b6a1-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (33adba20-7e4a-489f-aa0f-837730891086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20fd022-0003-4861-a5ba-572f1cee22a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20fd022-0003-4861-a5ba-572f1cee22a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952129610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39090a3b-1aef-4323-b4f9-ccffd2b0244b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:07Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7187cd5d-d563-4fe0-87d6-b462a27e633d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7187cd5d-d563-4fe0-87d6-b462a27e633d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49893fa3-211d-465b-86ef-53196605963d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49893fa3-211d-465b-86ef-53196605963d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39090a3b-1aef-4323-b4f9-ccffd2b0244b', 'volume_name': 'volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c480e46b-7bbd-4898-b851-17c1c6bf7445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c480e46b-7bbd-4898-b851-17c1c6bf7445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b311542-92e0-46b9-8302-6db4cc749639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:06 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Volume 39090a3b-1aef-4323-b4f9-ccffd2b0244b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b', 'volume_size': 1} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952129610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39090a3b-1aef-4323-b4f9-ccffd2b0244b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:07Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Creating volume 39090a3b-1aef-4323-b4f9-ccffd2b0244b {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:06 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:06 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b 1073741824 Jul 23 03:36:06 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:06 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:36:06 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:07 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.257s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 03:36:07 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b 1073741824" returned: 0 in 0.483s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:07 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b Jul 23 03:36:07 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:07 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b" returned: 0 in 0.336s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b311542-92e0-46b9-8302-6db4cc749639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524850fe-6bc0-45f3-93c8-97aca5ca4c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:07 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Volume volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b (39090a3b-1aef-4323-b4f9-ccffd2b0244b): created successfully Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524850fe-6bc0-45f3-93c8-97aca5ca4c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (33adba20-7e4a-489f-aa0f-837730891086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:07 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-e1087be1-2c8c-43eb-ab00-93964afd6d19 tempest-ProjectMemberTests-1042172611 None] Created volume successfully. Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Flow 'volume_create_manager' (5a6f5211-f893-44e8-8a5e-41d1c7f0371b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60be31d6-1cd0-4348-812a-03820a074789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60be31d6-1cd0-4348-812a-03820a074789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2136718905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1f0a21-2702-4ac6-ae33-5de5bb0f7855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01e83dc723c4fc9ad866bd71e6779d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:09Z,use_quota=True,user_id='7a862a800afb4307937c5a78328a5cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cea2104-bd31-43ac-9841-009cb7857af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cea2104-bd31-43ac-9841-009cb7857af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4b9baa-93c3-48c2-90ed-c51432cd1506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4b9baa-93c3-48c2-90ed-c51432cd1506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb1f0a21-2702-4ac6-ae33-5de5bb0f7855', 'volume_name': 'volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ebe4f8-7cff-43e9-85b0-5ed1ca1509d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ebe4f8-7cff-43e9-85b0-5ed1ca1509d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516ab1fa-623f-44bf-a70a-92aeda8cb971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:08 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Volume eb1f0a21-2702-4ac6-ae33-5de5bb0f7855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855', 'volume_size': 1} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2136718905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1f0a21-2702-4ac6-ae33-5de5bb0f7855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01e83dc723c4fc9ad866bd71e6779d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:09Z,use_quota=True,user_id='7a862a800afb4307937c5a78328a5cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Creating volume eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:08 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:36:08 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:08 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 1073741824 Jul 23 03:36:08 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:09 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 1073741824" returned: 0 in 0.418s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:09 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 Jul 23 03:36:09 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:09 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" returned: 0 in 0.240s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.558s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] Creating offline snapshot 236e77ab-1792-4bcd-8b07-ff90569c3c1d of volume 39090a3b-1aef-4323-b4f9-ccffd2b0244b {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516ab1fa-623f-44bf-a70a-92aeda8cb971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866ddbff-3508-4e4b-907e-b74f29e79d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6916e4a-a0eb-4588-8179-2a5cc1ac17bf]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:09 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Volume volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 (eb1f0a21-2702-4ac6-ae33-5de5bb0f7855): created successfully Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866ddbff-3508-4e4b-907e-b74f29e79d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:09 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Flow 'volume_create_manager' (5a6f5211-f893-44e8-8a5e-41d1c7f0371b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:09 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-75aaeeb0-51bc-475e-98a9-7b1070b2174e tempest-SnapshotDependencyTests-1047477371 None] Created volume successfully. Jul 23 03:36:09 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b Jul 23 03:36:09 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:10 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b" returned: 0 in 0.396s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:10 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d 1G Jul 23 03:36:10 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:10 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d 1G" returned: 0 in 0.397s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:10 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d Jul 23 03:36:10 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:10 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d" returned: 0 in 0.272s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:10 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d is being set with open permissions: ugo+rw Jul 23 03:36:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:10 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d Jul 23 03:36:10 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:10 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d" returned: 0 in 0.224s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:10 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:10 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.info Jul 23 03:36:10 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:11 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.info" returned: 0 in 0.261s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:11 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.info is being set with open permissions: ugo+rw Jul 23 03:36:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:11 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.info Jul 23 03:36:11 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:11 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.info" returned: 0 in 0.240s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.390s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:11 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] Creating offline snapshot 5a5178dd-b8ac-472d-8a2a-cfdf1bd029de of volume eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:36:11 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-9b70f18c-dc46-4266-9fae-58c6451cc084 tempest-ProjectMemberTests-1042172611 None] Create snapshot completed successfully Jul 23 03:36:11 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f7b5d9-8ede-4719-aac4-82fdcb43a019]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:11 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 Jul 23 03:36:11 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:11 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" returned: 0 in 0.347s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:11 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:11 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de 1G Jul 23 03:36:11 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-236e77ab-1792-4bcd-8b07-ff90569c3c1d-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:12 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de 1G" returned: 0 in 0.396s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-236e77ab-1792-4bcd-8b07-ff90569c3c1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-39090a3b-1aef-4323-b4f9-ccffd2b0244b" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:12 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de Jul 23 03:36:12 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-39090a3b-1aef-4323-b4f9-ccffd2b0244b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-236e77ab-1792-4bcd-8b07-ff90569c3c1d" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-236e77ab-1792-4bcd-8b07-ff90569c3c1d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Deleting offline snapshot 236e77ab-1792-4bcd-8b07-ff90569c3c1d of volume 39090a3b-1aef-4323-b4f9-ccffd2b0244b {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] snapshot_file for this snap is: volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a340e4b6-7bde-41c1-80af-0b49cba29161]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:12 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d Jul 23 03:36:12 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:12 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de" returned: 0 in 0.325s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:12 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de is being set with open permissions: ugo+rw Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:12 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de Jul 23 03:36:12 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:12 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d" returned: 0 in 0.397s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4795e3-398b-409c-8765-c47ac4323ea9]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:12 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de" returned: 0 in 0.256s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:12 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:12 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b Jul 23 03:36:12 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:12 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.info Jul 23 03:36:12 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:13 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.info" returned: 0 in 0.266s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:13 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.info is being set with open permissions: ugo+rw Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:13 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b" returned: 0 in 0.367s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:13 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.info Jul 23 03:36:13 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:13 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d Jul 23 03:36:13 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:13 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.info" returned: 0 in 0.246s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-0a3d29a3-b9d3-4dd9-b046-0599748a5dfa tempest-SnapshotDependencyTests-1047477371 None] Create snapshot completed successfully Jul 23 03:36:13 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d" returned: 0 in 0.394s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:13 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d Jul 23 03:36:13 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:13 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b.236e77ab-1792-4bcd-8b07-ff90569c3c1d" returned: 0 in 0.243s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-236e77ab-1792-4bcd-8b07-ff90569c3c1d" released by "_delete_snapshot" :: held 1.498s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-39090a3b-1aef-4323-b4f9-ccffd2b0244b" released by "delete_snapshot" :: held 1.526s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Created reservations ['0f994dfc-91a0-4e46-9103-11b9c6b681ce', '92107b94-df61-4231-807a-fc10af27ec8c', '16c744ab-0c6c-4348-851f-634b5cd60373', '2f997bac-ed1f-4615-bf8c-ff9ccc1a6d06'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:13 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Delete snapshot completed successfully. Jul 23 03:36:13 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-c6103da4-1d95-4c3d-9561-a526a8de1569 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-236e77ab-1792-4bcd-8b07-ff90569c3c1d-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-39090a3b-1aef-4323-b4f9-ccffd2b0244b-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-39090a3b-1aef-4323-b4f9-ccffd2b0244b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-39090a3b-1aef-4323-b4f9-ccffd2b0244b" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-39090a3b-1aef-4323-b4f9-ccffd2b0244b" acquired by "delete_volume" :: waited 0.014s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da96d68-a950-4974-99a8-9c00ac0bc4e4]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:14 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b Jul 23 03:36:14 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:14 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b" returned: 0 in 0.375s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Flow 'volume_create_manager' (06b3fd3f-7615-4e5a-9679-da494d8668a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:14 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b Jul 23 03:36:14 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1090d3f-41e0-42fb-aeed-128d3b1b73f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1090d3f-41e0-42fb-aeed-128d3b1b73f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cda3e17-7dbe-4b24-bc8d-10c5fef597d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01e83dc723c4fc9ad866bd71e6779d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a5178dd-b8ac-472d-8a2a-cfdf1bd029de,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:15Z,use_quota=True,user_id='7a862a800afb4307937c5a78328a5cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e39e3ff-6383-490a-83aa-5d829afc7ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e39e3ff-6383-490a-83aa-5d829afc7ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c193000e-0c56-4f9c-a3dc-8d4f1518ccc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c193000e-0c56-4f9c-a3dc-8d4f1518ccc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7cda3e17-7dbe-4b24-bc8d-10c5fef597d4', 'volume_name': 'volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4', 'volume_size': 1, 'snapshot_id': '5a5178dd-b8ac-472d-8a2a-cfdf1bd029de'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ed5b89-8887-4f27-85e1-4eaea07bc70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ed5b89-8887-4f27-85e1-4eaea07bc70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849b8670-844e-485f-bad0-a94fafa28540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:14 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Volume 7cda3e17-7dbe-4b24-bc8d-10c5fef597d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4', 'volume_size': 1, 'snapshot_id': '5a5178dd-b8ac-472d-8a2a-cfdf1bd029de'} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:14 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "cinder-quobyte-5a5178dd-b8ac-472d-8a2a-cfdf1bd029de-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" by "_create_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-5a5178dd-b8ac-472d-8a2a-cfdf1bd029de-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Creating volume 7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 from snapshot 5a5178dd-b8ac-472d-8a2a-cfdf1bd029de {{(pid=88392) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "cinder-quobyte-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" by "_copy_volume_from_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] snapshot: 5a5178dd-b8ac-472d-8a2a-cfdf1bd029de, volume: 7cda3e17-7dbe-4b24-bc8d-10c5fef597d4, {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa546ac-b017-440a-b185-0415d52af24d]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:15 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-39090a3b-1aef-4323-b4f9-ccffd2b0244b" returned: 0 in 0.267s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-39090a3b-1aef-4323-b4f9-ccffd2b0244b" released by "delete_volume" :: held 0.707s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:15 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de Jul 23 03:36:15 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Created reservations ['6307e534-72f0-4f7e-88fc-693e742560ca', 'b4d2132d-b03b-44b7-bddf-9a9176a10db1', '7e864824-ab60-42b8-aacb-8a8dab9743f2', '9bc96c2c-3e8e-41cd-8f6e-58cd0cbb7bec'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:15 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:36:15 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:15 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de" returned: 0 in 0.411s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Creating direct copy from snapshot {{(pid=88392) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[9535c5e6-5465-4d88-9f5e-dc4b1b211332]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:15 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.254s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:15 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Deleted volume successfully. Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-b7ed050c-3039-4b5f-8261-6be7b76a09c4 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-39090a3b-1aef-4323-b4f9-ccffd2b0244b-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:15 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 Jul 23 03:36:15 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:15 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" returned: 0 in 0.460s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG cinder.utils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Path /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 not found in is_blk_device check {{(pid=88392) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 03:36:15 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:15 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 Jul 23 03:36:15 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG cinder.volume.flows.manager.create_volume [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88392) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (ce027a78-0ea8-4d83-92f1-0c3fe56de7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce93076-64a8-41fa-b1ba-9711170b2699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce93076-64a8-41fa-b1ba-9711170b2699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982974245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b5d4ab-1c17-472d-933f-c6ad5531a67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:16Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbca933-e976-4fa0-ab9d-f2b697d94a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbca933-e976-4fa0-ab9d-f2b697d94a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd1260d-f93e-4c5d-a32a-ca19a880bcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd1260d-f93e-4c5d-a32a-ca19a880bcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82b5d4ab-1c17-472d-933f-c6ad5531a67c', 'volume_name': 'volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621e99ac-a5a8-4140-ade6-dca462440b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621e99ac-a5a8-4140-ade6-dca462440b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b9f18a-99e7-4961-bb90-8f860520c5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:16 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Volume 82b5d4ab-1c17-472d-933f-c6ad5531a67c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c', 'volume_size': 1} Jul 23 03:36:16 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:20 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" returned: 0 in 4.225s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:20 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18d83a4-7b13-497e-b61f-4105595d0cd9]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:20 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 Jul 23 03:36:20 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:20 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" returned: 0 in 0.563s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:20 devstack cinder-volume[88392]: DEBUG cinder.image.image_utils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 {{(pid=88392) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 03:36:20 devstack cinder-volume[88392]: INFO cinder.image.image_utils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Converted 1024.00 MB image at 242.29 MB/s Jul 23 03:36:20 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 is being set with open permissions: ugo+rw Jul 23 03:36:20 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:20 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 Jul 23 03:36:20 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:21 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" returned: 0 in 0.241s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" released by "_copy_volume_from_snapshot" :: held 5.998s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-5a5178dd-b8ac-472d-8a2a-cfdf1bd029de-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" released by "_create_volume_from_snapshot" :: held 6.027s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.041s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.897s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T01:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982974245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b5d4ab-1c17-472d-933f-c6ad5531a67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5448ccb17c241b199bed2838b0d1fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T01:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T01:36:16Z,use_quota=True,user_id='63403332071b409aa9d36d7a93c63996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(785e17ff-9d91-4abb-bfc3-2b812a66638f),volume_type_id=785e17ff-9d91-4abb-bfc3-2b812a66638f)}" {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Creating volume 82b5d4ab-1c17-472d-933f-c6ad5531a67c {{(pid=88392) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Selected osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 as target Quobyte volume. {{(pid=88392) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 23 03:36:21 devstack cinder-volume[88392]: INFO cinder.volume.drivers.remotefs [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] casted to osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173 Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c 1073741824 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:21 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c 1073741824 Jul 23 03:36:21 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849b8670-844e-485f-bad0-a94fafa28540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4', 'volume_size': 1, 'snapshot_id': '5a5178dd-b8ac-472d-8a2a-cfdf1bd029de'}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7719f8-46b5-409c-b618-c4f0727eab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:21 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Volume volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 (7cda3e17-7dbe-4b24-bc8d-10c5fef597d4): created successfully Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed7719f8-46b5-409c-b618-c4f0727eab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Flow 'volume_create_manager' (06b3fd3f-7615-4e5a-9679-da494d8668a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:21 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-ffe3ccc2-2590-4587-b3ce-21554feb39f3 tempest-SnapshotDependencyTests-1047477371 None] Created volume successfully. Jul 23 03:36:21 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "cinder-5a5178dd-b8ac-472d-8a2a-cfdf1bd029de-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c 1073741824" returned: 0 in 0.464s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-5a5178dd-b8ac-472d-8a2a-cfdf1bd029de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "cinder-quobyte-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "cinder-quobyte-5a5178dd-b8ac-472d-8a2a-cfdf1bd029de" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-5a5178dd-b8ac-472d-8a2a-cfdf1bd029de" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Deleting offline snapshot 5a5178dd-b8ac-472d-8a2a-cfdf1bd029de of volume eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:21 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c Jul 23 03:36:21 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] snapshot_file for this snap is: volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ec5ea3-9438-4f3f-be52-103c72bf03a5]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:21 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de Jul 23 03:36:21 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:21 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c" returned: 0 in 0.249s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'} {{(pid=88392) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b9f18a-99e7-4961-bb90-8f860520c5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c', 'volume_size': 1}' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0864e15f-48e0-4075-a7ee-7da7eed0e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 03:36:21 devstack cinder-volume[88392]: INFO cinder.volume.flows.manager.create_volume [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Volume volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c (82b5d4ab-1c17-472d-933f-c6ad5531a67c): created successfully Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0864e15f-48e0-4075-a7ee-7da7eed0e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88392) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Flow 'volume_create_manager' (ce027a78-0ea8-4d83-92f1-0c3fe56de7c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88392) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 03:36:21 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-566d10cf-b684-4f0b-8456-eb0159f6f865 tempest-ProjectMemberTests-1042172611 None] Created volume successfully. Jul 23 03:36:21 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de" returned: 0 in 0.368s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaed910e-f53f-43e0-8951-e403d7abe2d5]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:21 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:22 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 Jul 23 03:36:22 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:22 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" returned: 0 in 0.354s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:22 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de Jul 23 03:36:22 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:22 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de" returned: 0 in 0.363s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:22 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de Jul 23 03:36:22 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:22 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] Creating offline snapshot e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 of volume 82b5d4ab-1c17-472d-933f-c6ad5531a67c {{(pid=88392) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2066}} Jul 23 03:36:22 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[925a92d8-b509-4067-9c56-27a032d4a0c3]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:22 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c Jul 23 03:36:22 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:22 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:22 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855.5a5178dd-b8ac-472d-8a2a-cfdf1bd029de" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-5a5178dd-b8ac-472d-8a2a-cfdf1bd029de" released by "_delete_snapshot" :: held 1.438s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" released by "delete_snapshot" :: held 1.470s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Created reservations ['290d0049-cbc7-40d7-92ce-f9011cb7378b', '26cff4b6-0d07-47fe-a868-fe8950616be2', '3a93c2fb-f7a6-462f-b0ee-dd7c7248e9d2', '3582e904-da81-4dfc-bf8b-1f855541c70d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:23 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Delete snapshot completed successfully. Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-65fec2e9-d493-4fff-960b-65094511a3cc tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-5a5178dd-b8ac-472d-8a2a-cfdf1bd029de-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:23 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c" returned: 0 in 0.382s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 1G {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:23 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 1G Jul 23 03:36:23 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:23 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 1G" returned: 0 in 0.369s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:23 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 Jul 23 03:36:23 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "cinder-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "cinder-quobyte-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2219dd7-51d6-4946-bd0b-0cd45a38fa2c]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:23 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c -F qcow2 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2" returned: 0 in 0.287s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:23 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 is being set with open permissions: ugo+rw Jul 23 03:36:23 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:23 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 Jul 23 03:36:23 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:23 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 Jul 23 03:36:23 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:24 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2" returned: 0 in 0.231s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:24 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.info Jul 23 03:36:24 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:24 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" returned: 0 in 0.368s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:24 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855 Jul 23 03:36:24 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:24 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.info" returned: 0 in 0.247s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:24 devstack cinder-volume[88392]: WARNING cinder.volume.drivers.remotefs [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.info is being set with open permissions: ugo+rw Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.info {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:24 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.info Jul 23 03:36:24 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:24 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" returned: 0 in 0.236s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855" released by "delete_volume" :: held 0.673s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Created reservations ['1ce49bac-91e3-4c6f-9ecb-b8d64b813cc0', 'd617f7ba-ea76-4add-983a-a5ebe2847d39', '31d41cbe-bfe3-433f-8c9a-0a37fe2b2993', '4b9ab15d-8c19-4a5a-a267-923c54782f44'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:24 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:36:24 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:24 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.info" returned: 0 in 0.243s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:24 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-f0a4662a-899b-49f4-8166-e72b0b545d5b tempest-ProjectMemberTests-1042172611 None] Create snapshot completed successfully Jul 23 03:36:24 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.268s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:24 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Deleted volume successfully. Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-490098c6-a861-44a0-980c-09f34826df57 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-eb1f0a21-2702-4ac6-ae33-5de5bb0f7855-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "cinder-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "cinder-quobyte-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" acquired by "delete_volume" :: waited 0.015s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[023e10ed-2d03-420e-be33-7f55e2fb21df]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:24 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2-delete_snapshot" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Lock "cinder-e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-82b5d4ab-1c17-472d-933f-c6ad5531a67c" by "delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-82b5d4ab-1c17-472d-933f-c6ad5531a67c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2" by "_delete_snapshot" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:25 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 Jul 23 03:36:25 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Deleting offline snapshot e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 of volume 82b5d4ab-1c17-472d-933f-c6ad5531a67c {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] snapshot_file for this snap is: volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 {{(pid=88392) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1322}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d79ed3-b409-4673-935c-9019a04ecb3e]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:25 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 Jul 23 03:36:25 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:25 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" returned: 0 in 0.375s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:25 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4 Jul 23 03:36:25 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:25 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2" returned: 0 in 0.362s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.remotefs [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88392) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d324c0c-97f5-4569-a364-ca836b83eb98]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:25 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" returned: 0 in 0.242s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-quobyte-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4" released by "delete_volume" :: held 0.657s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:25 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c Jul 23 03:36:25 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Created reservations ['7ac1e36c-7d37-4b5c-bb5e-cfc2d1d2cbea', '1f343dca-ddba-4ea2-a7ff-3c91cbd6d1ac', '15f86211-5b4b-4abd-92dc-12de40ea7461', '9e60bd9d-5b64-4e22-9b0e-1dceb6be58aa'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:25 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:36:25 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:25 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c" returned: 0 in 0.358s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:25 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 Jul 23 03:36:25 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:25 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.256s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:25 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:25 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Deleted volume successfully. Jul 23 03:36:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-5200859d-e12d-4d4a-924f-f03dea940590 tempest-SnapshotDependencyTests-1047477371 None] Lock "cinder-7cda3e17-7dbe-4b24-bc8d-10c5fef597d4-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:26 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2" returned: 0 in 0.350s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:26 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2 Jul 23 03:36:26 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:26 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:26 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c.e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2" returned: 0 in 0.258s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2" released by "_delete_snapshot" :: held 1.434s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-82b5d4ab-1c17-472d-933f-c6ad5531a67c" released by "delete_snapshot" :: held 1.454s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:26 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Created reservations ['b987c8d5-49b6-482f-a862-1e4818803e71', '0d93eaee-52f8-4d12-b3fa-fcd9c115baf7', 'd6d4c83d-0130-41a9-9daf-b270291422e8', '16ba6250-c204-4b60-9a01-c184bf5bf92d'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:26 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Delete snapshot completed successfully. Jul 23 03:36:26 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-950615dd-e25c-46e3-b15b-5a3179f8997b tempest-ProjectMemberTests-1042172611 None] Lock "cinder-e4ad6a64-4cd8-4cd8-8b0a-9e217fbd30f2-delete_snapshot" released by "delete_snapshot" :: held 1.603s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-82b5d4ab-1c17-472d-933f-c6ad5531a67c-delete_volume" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-82b5d4ab-1c17-472d-933f-c6ad5531a67c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "cinder-quobyte-82b5d4ab-1c17-472d-933f-c6ad5531a67c" by "delete_volume" {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 03:36:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-82b5d4ab-1c17-472d-933f-c6ad5531a67c" acquired by "delete_volume" :: waited 0.017s {{(pid=88392) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 03:36:27 devstack cinder-volume[88392]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd826919-6acb-4280-807a-a3074031f2c3]: (4, 'qcow2') {{(pid=90167) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 03:36:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:27 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c Jul 23 03:36:27 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:27 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c" returned: 0 in 0.398s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:27 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c Jul 23 03:36:27 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:27 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:27 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00/volume-82b5d4ab-1c17-472d-933f-c6ad5531a67c" returned: 0 in 0.247s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:27 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-quobyte-82b5d4ab-1c17-472d-933f-c6ad5531a67c" released by "delete_volume" :: held 0.704s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:28 devstack cinder-volume[88392]: DEBUG cinder.quota [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Created reservations ['6a576c56-cf46-46f2-a6af-804dea92c875', 'e54676ae-04c5-4c6d-851d-fc7623d01ad8', 'f2d2b6fc-a467-4311-aad2-a77a19a1a2d0', 'd24a6133-75d9-4785-9789-7c5a1f2e4f97'] {{(pid=88392) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 03:36:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:36:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:36:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:36:28 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:36:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:36:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:36:28 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:36:28 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:36:28 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 23 03:36:28 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.259s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:36:28 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:36:28 devstack cinder-volume[88392]: INFO cinder.volume.manager [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Deleted volume successfully. Jul 23 03:36:28 devstack cinder-volume[88392]: DEBUG cinder.coordination [None req-22b3fea6-cf91-423f-9c9a-a6635d49c900 tempest-ProjectMemberTests-1042172611 None] Lock "cinder-82b5d4ab-1c17-472d-933f-c6ad5531a67c-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=88392) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 03:36:38 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=93,cinder:SELECT=69,cinder:DELETE=9,cinder:INSERT=21 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:36:38 devstack cinder-volume[88392]: DEBUG dbcounter [-] [88392] Writing DB stats cinder:UPDATE=86,cinder:SELECT=66,cinder:INSERT=23,cinder:DELETE=6 {{(pid=88392) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 03:37:06 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:37:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 03:37:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 03:37:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173': None} {{(pid=88392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 23 03:37:06 devstack cinder-volume[88392]: DEBUG cinder.volume.drivers.quobyte [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ef05a0d5-6055-4cc2-b596-139a1dfe3173'] {{(pid=88392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 23 03:37:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.lockutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88392) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 03:37:06 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 03:37:06 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00 Jul 23 03:37:06 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 03:37:07 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jul 23 03:37:07 devstack cinder-volume[88392]: DEBUG oslo_concurrency.processutils [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d86ac1258d195ad33876999d8ee2c00" returned: 0 in 0.246s {{(pid=88392) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 03:37:07 devstack cinder-volume[88392]: DEBUG cinder.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Notifying Schedulers of capabilities ... {{(pid=88392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 03:37:07 devstack cinder-volume[88392]: DEBUG oslo_service.periodic_task [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] Running periodic task VolumeManager._thread_info {{(pid=88392) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 03:37:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread count: 28 {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 03:37:07 devstack cinder-volume[88392]: DEBUG cinder.volume.manager [None req-d5f17eed-70a5-4b15-8949-af37c0fea43b None None] thread info: [<_MainThread(MainThread, started 127410522235008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88392) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}